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ABSTRACT 


This  thesis  evaluates  techniques  for  forecasting  the 
return  of  failed  repairable  spare  parts  (knovm  as  carcasses) 
within  the  U.  S.  Navy  supply  system  by  comparing  the  model 
currently  implemented  in  the  Uniform  Automated  Data  Process¬ 
ing  System  Inventory  Control  Point  (UICP)  program  with 
several  alternative  forecasting  models  to  determine  if  eui 
improvement  cem  be  achieved  in  forecasting  effectiveness. 

The  current  model  uses  an  exponential  smoothing  procedure 
and  applies  several  filtering  processes  to  determine  the 
appropriate  smoothing  constant  value.  The  alternative  models 
employ  forecasting  techniques  such  as  moving  average,  moving 
least  squares,  adaptive  response  rate,  and  regression 
analysis.  Each  model  is  then  synthesized  with  actual  U.  S. 

Navy  supply  system  data  and  its  performance  measured  by  a 
set  of  evaluation  criteria.  The  results  indicate  that  the 
current  UICP  forecasting  model  cannot  be  improved  substantially 
and  that  a  filtering  process  is  critical  to  the  performance  of 
any  model  applied  to  real  world  data. 
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I.  INTRODUCTION 


This  thesis  con^ares  the  model  currently  implemented  in 
the  Uniform  Automated  Data  Processing  System  Inventory 
Control  Point  (UICP)  program  for  forecasting  the  return  of 
failed  repairable  spare  parts  (knovm  as  carcasses)  with 
several  alternative  forecasting  models  to  determine  if  an 
improvement  can  be  achieved  in  forecasting  effectiveness . 
While  the  results  of  a  study  of  forecasting  techniques 
could  apply  to  memy  aspects  of  the  U.S.  Navy  repairable 
system,  this  study  will  specifically  address  only 
SPCC>managed  non-aviation  items. 

The  primary  function  of  the  repair ables  inventory  system 
is  to  maintain  a  high  state  of  fleet  readiness  through 
material  availability  by  efficient  workload  scheduling  and 
maximizing  financial  resource  allocations.  The  motivation 
behind  this  study  is  to  look  at  one  portion  of  the 
logistics  system  and  determine  if  the  currently  employed 
forecasting  techniques  could  be  improved  towards  this 
end. 

The  forecasting  of  carcass  returns  within  the  supply 
system  plays  a  key  role  in  both  workload  planning  and 
budgeting.  The  carcass  return  forecast  and  the  estimated 
demand  determine  the  funding  levels  required  to  service  the 
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failed  units  for  reissue  and  the  shortfall  of  units  that 
must  be  funded  as  new  purchases.  Currently  SPCC  uses  an 
exponential  smoothing  model  with  filters  to  forecast 
carcass  returns.  The  scope  of  this  thesis  will  be  to 
formulate  and  test  various  forecasting  models  and  to  compare 
them  to  the  current  SPCC  model.  These  models  employ  fore« 
casting  techniques  such  as  moving  average,  moving  least 
squares,  adaptive  response  rate,  and  several  regression 
analysis  schemes.  Each  mode  will  be  analyzed  using  two 
years  of  actual  demand  and  carcass  return  data  from  a 
selected  subgroup  of  repairable  items  managed  by  SPCC  and 
evaluated  with  respect  to  various  decision  criteria. 

The  thesis  will  first  provide  an  overview  of  the 
repairable  systems  within  the  U.S.  Navy  and  present  the 
role  of  the  Inventory  Control  Point  (ICP)  in  the  system. 

The  overview  includes  discussion  of  the  data  files  and  the 
progreuns  and  basic  inventory  models  used  by  the  ICP.  Then 
the  forecasting  algorithms  and  the  motivation  behind  each 
examined  forecasting  model  is  presented.  A  separate  section 
on  model  building  concentrates  on  the  evolution  of  regres¬ 
sion  models.  The  data  selection  criteria  and  the  data 
collection  procedure  are  addressed,  and  the  measures  of 
effectiveness  that  are  used  to  evaluate  the  models  are 
discussed.  Finally,  the  numerical  results  of  the  study 
are  presented  emd  discussed  with  respect  to  applicaUaility 
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euld  inplementation .  In  general /  the  results  indicate,  first, 
that  the  current  UICP  forecasting  model  cannot  be  sub¬ 
stantially  improved  using  the  types  of  models  considered 
here  and,  second,  that  a  filtering  process  is  critical  to 
the  performance  of  the  models  when  applied  to  real-world 
data. 
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II.  THE  CURRENT  NAVY  REPAIRABLES  SYSTEM 


A.  THE  REPAIRABLES  CYCLE 

Repairable  spare  parts  are  big  business  in  the  Navy 
today.  Repairables  became  an  economic  necessity  with  the 
advent  of  increasing  technological  complexity  of  weapon 
systems  and  the  rising  costs  of  their  components.  Many  of 
those  components  are  not  repairable  onboard  ship  or  at 
intermediate  maintenance  levels  and  must  be  repaired  at  a 
depot  (Depot  Level  Repairables  -  DLR) .  Repairable  items 
include  electron  tubes,  circuit  boards,  test  equipment, 
pumps,  motors,  turbine  rotors,  amplifiers,  power  supplies, 
etc.  A  key  to  fleet  readiness  is  the  availability  of  spare 
components  within  the  supply  system  to  keep  these  systems 
operational.  Today,  SPCC  manages  approximately  100,000 
repairable  items  accounting  for  annual  sales  of  approximately 
$20  million. 

A  part  is  classified  as  a  repairable  item  rather  than  a 
consumable  item  if  it  is  more  economical  to  take  that  part 
back  into  the  supply  system  and  repair  it  for  future  use 
rather  than  purchase  a  new  one.  Repair  costs  including 
transportation,  storage  and  handling  generally  average 
40-60  percent  of  the  replacement  price  of  the  item. 

Repair  turnaround  time  versus  procurement  lead  time  is  also 
a  key  factor  with  repair  times  normally  ranging  from  90  to 
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180  days,  as  compared  to  the  purchasing  cycles  of  up  to  two 
yeeurs.  The  reasons  for  this  difference  in  leadtimes  vary, 
but,  in  general,  the  "repair  bench"  and  piece  parts  are  in 
place  or  readily  accessible,  whereas  the  manufacturer  must 
tool  up  amd  obtain  the  raw  materials  and  components  to 
produce  a  new  part.  In  other  cases,  there  may  be  no  pro¬ 
curement  sources  available  and  repair  is  the  only 
alternative . 

The  addition  of  a  repairable  system  within  the  supply 
distribution  system  adds  a  unique  dimension  from  the 
logistics  point  of  view.  In  the  private  sector  the 
logistician's  work  is  basically  completed  once  the  product 
reaches  the  customer.  If  the  product  subsequently  fails, 
the  customer  is  responsible  for  pursuing  repair  actions  or 
replacement.  However,  parallel  systems,  one  for  forward 
physical  distribution  and  one  for  failed  unit  (carcass) 
returns  or  retrogrades ,  must  be  formed  to  support  Navy 
repair2bles.  Carcass  collection  and  overhaul  points  must 
be  designated,  transportation  facilities  established,  and 
complex  inventory  control  decisions  must  be  made.  These 
decisions  include  the  number  of  carcasses  to  induct  into 
the  repair  cycle  and  when,  the  number  of  new  DLRs  to 
procure  to  replace  normal  attrition  and  increased  demand, 
and  the  number  of  units  to  procure  based  upon  manufacturing 
costs  and  lead  times  and  the  reorder  levels. 


The  Navy  repairable  system  for  an  SPCC  managed  item  is 
depicted  graphically  in  Figure  1.  Figure  1  illustrates  the 
theoretical  flow  of  the  OLR  and  attendant  information  flow. 
When  a  failure  occurs,  the  customer  initiates  a  requisition 
or  "demand"  document  to  obtain  a  replacement  part  (desig¬ 
nated  Ready  For  Issue  (RFI)).  Under  the  Area  Supply  Support 
Concept,  the  customer  submits  his  requisition  to  the  nearest 
stock  point.  This  allows  the  stock  point  to  record  a 
demand,  or  hit,  for  future  stocking  computations. 

If  the  stock  point  has  the  item  in  stock,  it  issues  the 
part  to  the  customer  and  electronically  tremsmits  a  report 
of  the  issue  to  the  ICP  via  the  Transaction  Item  Reporting 
(TIR)  system.  The  TIR  is  processed  by  the  ICP,  adjusting 
on-hand  balances  for  that  part,  recording  the  demand  and 
establishing  a  "due-in"  for  the  NRFI  (Not  Ready  For  Issue) 
unit. 

If  the  stock  point  is  temporarily  out  of  the  desired 
item  or  does  not  normally  carry  the  part,  the  requisition 
is  forwarded  to  the  ICP  for  disposition.  The  ICP  processes 
the  demeuid  by  forwarding  it  to  an  activity  that  does  have 
stock  on-hand  or  backorders  the  items  for  release  against 
forthcoming  RFI  assets,  and  adjusts  the  records 
accordingly . 

When  the  customer  receives  the  RFI  unit  and  installs  it, 
he  is  operational  again.  His  role  in  the  cycle  is  not 
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complete,  however,  until  he  returns  the  failed  unit  (called 
a  carcass  and  designated  NRFI)  to  the  system  so  it  C2m  be 
repaired  and  placed  back  on  the  shelf  as  an  RFI  unit.  The 
customer  consults  the  Master  Repairable  Item  List  (MRIL)  to 
determine  the  disposition  of  the  carcass.  The  MRIL 
includes  the  Movement  Priority  Designator  (MPD)  which  is 
assigned  by  the  ICP  and  determines  the  transportation 
priority  of  the  movement  of  the  carcass.  Once  the  NRFI 
unit  is  turned  in  (either  at  the  time  the  initial  demand 
is  placed  or  subsequent  to  that) ,  the  stock  point  notifies 
the  ICP  through  a  TIR  cuid  the  due-in  is  cancelled.  The 
collection  point  (CP)  is  a  location  designated  to  receive 
and  store  all  NRFI  units  until  they  are  to  be  inducted  into 
the  repair  cycle.  It  can  be  either  a  stock  point  or  the 
designated  overhaul  point  (OOP).  Therefore,  if  the  stock 
point  receiving  the  NRFI  item  is  the  CP,  it  holds  the 
material;  otherwise  it  forwards  the  unit  to  the  designated 
CP  in  accordance  with  MPD.  The  inventory  manager  then 
decides  how  best  to  get  a  unit  back  on  the  shelf  at  the 
issuing  stock  point.  This  decision  may  mean  the  initiation 
of  a  repair  action  on  a  failed  unit  or  the  procurement  of  a 
new  RFI  item.  These  decisions  are  a  function  of  recurring 
demand  forecasts,  carcasses  currently  in  the  repair  cycle, 
NRFI  assets  awaiting  repair  at  the  CP,  repair  lead  times, 
procurement  lead  times,  and  budgetary  constraints.  If  the 
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decision  is  to  repair  the  unit,  the  unit  is  inducted  into 
the  repair  cycle  at  one  of  over  20  Navy  industrial  facili¬ 
ties  or  250  commercial  designated  overhaul  points.  Once 
repair  action  is  complete,  the  RFI  item  is  directed  to 
a  specific  stock  point  by  the  ICP  in  the  Redistribution 
Phase.  The  stock  point  receives  and  stores  the  RFI  item 
until  it  is  subsequently  required  to  fill  a  requisition.  If 
the  decision  to  procure  a  new  unit  is  made,  a  contract  is 
established  with  a  manufacturer  and  the  new  unit  is  sent  to 
the  designated  stock  point. 

Figure  2  illustrates  the  repairables  pipeline.  Ideal¬ 
ly,  the  system  should  function  as  closed  loop  with  no  loss 
of  units  from  turn-in  to  reissue.  In  practice,  losses  of 
units  occur  at  three  points:  (1)  during  the  Exchange  Phase 
when  the  customer  either  does  not  have  an  NRFI  unit  to  turn 
in  or  it  is  lost  in  transit  to  the  collection  point;  (2) 
during  the  Retrograde  Phase  when  units  are  misplaced  or  are 
determined  irreparable  by  the  stock  point  and  surveyed;  and 
(3)  during  the  Repair  Phase  when  the  unit  is  determined  to 
be  beyond  economic  repair  by  the  DOP.  These  losses  or 
"attrition"  demands  must  be  made  up  by  an  infusion  of  units 
into  the  system  through  procurement. 

This  general  outline  applies  only  to  existing  systems 
and  does  not  address  non-recurring  demands  such  as  initial 
outfitting,  planned  maintenance,  ROH  refitting/backfitting. 
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LOSS/DISPOSAL  OF  NRFI  UNITS 
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«tc.,  which  are  funded  by  the  Hardware  Systems  Command  (HSC) 
(e.g.  NAVAIR,  NAVSEA,  NAVELEX,  etc.).  The  recurring  demand 
portion  of  the  repairedsles  system  becomes  involved  only 
after  the  first  failure  for  these  items. 

B.  THE  ICP  AND  THE  CICP  SYSTEM 

To  get  a  basic  understanding  of  the  role  that  carcass 
return  forecasting  plays  in  the  overall  repairables  cycle 
it  is  importamt  to  look  at  the  ICP  functions.  The  previous 
general  discussion  of  the  repairables  cycle  can  be  repre¬ 
sented  basically  as  a  wheel  of  repaircdsles  activity 
through  the  Uniform  Automated  Data  Processing  System  - 
Inventory  Control  Point  (UICP)  generated  and  maintained 
by  the  Fleet  Material  Support  Office  (FMSO) .  Item  managers, 
located  at  each  ICP,  are  personally  responsible  for  moni¬ 
toring  and  directing  the  inventory  control  life  of  specific 
items.  The  item  manager  is  the  human  aspect  of  the  UICP 
system.  He  receives  the  UlCP-generated  information  and 
makes  critical  inventory  control  decisions  concerning  the 
procurement,  repair,  and  distribution  of  an  item.  The 
following  presentation  will  discuss  some  of  the  UICP  files 
that  are  maintained  in  support  of  the  repairables  program 
and  associated  UICP  programs  that  actually  manipulate  the 
files  to  provide  the  repair/procure  decisions  and  determine 
budgetary  requirements  for  the  system.  Figure  3  is  a 
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graphic  display  of  the  relationship  between  the  major  UICP 
repair^d^les  files  and  programs. 

The  Master  Data  File  (MDF)  contains  the  key  data 
required  to  operate  an  inventory  control  system.  Data  is 
filed  by  National  Item  Identification  Number  (NIIN) .  Infor¬ 
mation  about  each  item  is  stored  in  individually  accessed 
locations  called  data  element  numbers  or  DEN's.  Each  NIIN 
has  approximately  400  accompanying  DEN's  that  contain  such 
information  as  current  inventory  position,  demand  emd 
carcass  return  observations  for  the  current  quarter,  demand 
emd  carcass  return  forecasts,  procurement  and  repair  lead 
times  euid  turnaround  times,  dimensions,  weight,  standard  and 
replacement  prices,  packing  and  preservation  information, 
etc.  The  MDF  is  accessed  via  real-time  data  retrieval. 

The  Planned  Program  Requirement  Pile  (PPR)  keeps  track 
of  all  known  requirements  (also  called  non-recurring 
demands)  for  RFI  assets  based  upon  requests  from  HSC's, 
industrial  activities,  customers  and  item  managers.  The 
PPR  can  be  accessed  in  real  time. 

The  Due-in/Due-out  File  (DDF)  tracks  every  outstanding 
supply  action  until  its  completion  or  termination.  It 
follows  ICP  directed  issues  and  expected  receipts  (such  as 
carcass  returns  once  a  repairable  item  has  been  issued  to 
a  customer) .  It  also  tracks  incoming  RFI  assets  from  both 
repair  and  procurement,  the  redistribution  of  assets  among 
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stock  points  emd  OOPs,  and  items  going  into  and  out  of  the 
Repair  Phase.  The  DDF  can  also  be  accessed  in  real  time. 

The  Transaction  History  File  (THF)  contains  all  the 
trauisactions  recorded  at  the  ICP  over  the  preceeding  two 
year  period.  It  lists  each  transaction  individually  by 
document  number  and  provides  a  source  of  historical  data 
for  demand  observations,  carcass  returns,  procurement  lead 
times,  and  repair  turnaround  times.  This  file  is  on  tape 
and  can  only  be  accessed  through  batch  processing. 

The  Inventory  History  File  (IHF)  is  also  a  tape  file 
that  is  accessed  by  batch  processing.  The  IHF  contains 
demand  and  carcass  return  observations  for  the  previous 
eight  quarters  as  well  as  inventory  position  quantities, 
lead  times  and  turnaround  times. 

C.  THE  TIR  SYSTEM 

The  discussion  will  now  focus  on  the  UICP  programs  that 
access  the  data  files  described  above  and  will  explain  how 
they  relate  to  carcass  return  forecasting.  First,  it  is 
import2uit  to  understand  the  Transaction  Item  Reporting  (TIR) 
system.  If  the  repairables  system  can  be  thought  of  as  a 
wheel  with  the  repairable  item  moving  around  the  rim  and 
the  ICP  at  the  hub,  the  spokes  of  the  wheel  represent  the 
TIR  system.  The  TIR  system  is  an  information  system  that 
informs  the  ICP  of  every  change  in  status  of  one  of  its 
wholesale  system  assets.  That  change  in  status  can  include 


receipts  of  due-ins,  carcass  turn- ins,  issues  of  RFI  items, 
forwarding  carcasses  for  repair,  and  inductions  of  carcasses 
into  repair.  TIR  reports  are  sent  via  AUTODIN  or  message. 

At  the  end  of  each  day  an  "accounting"  is  made  of  all 
transactions  at  a  TIR  activity  and  the  transactions  are 
TIR'ed  to  the  ICP  to  update  the  asset  position  on  all 
inventory  control  records.  The  commands  that  report  daily 
to  the  ICP  are  referred  to  as  being  on  the  "wheel"  and  are 
called  TIR  reporting  activities  (stock  points,  industrial 
activities,  some  air  stations  and  some  mobile  logistic 
support  force  ships).  The  ICP's  also  do  business  with  non- 
TIR  activities  which  are,  in  general,  commercial  OOP's. 

When  a  repairable  item  is  sent  to  a  non-TIR  activity  a  due- 
in  is  established  in  the  DDF  and  a  blackout  of  information 
for  that  particular  item  is  experienced  pending  its  return 
to  a  TIR  activity.  Non-TIR  activities  do  provide  monthly 
inventory  position  reports  to  the  ICP,  but  the  information 
is  not  available  in  real  time  like  the  TIR.  The  progress 
of  a  repairable  item  is  followed  through  the  system  by  the 
item's  condition  code  which  is  reported  via  TIR.  The 
following  condition  codes  (Ref.  3J  generally  apply  to 
repairables: 

Condition  Code  Status 

A  Serviceable  (Issuable  W/0  Qual) 

F  Unserviceable  (Repairable) 

H  Unserviceable  (Condemned) 

M  Suspended  (In  Work) 


22 


When  a  carcass  is  turned  in  by  the  customer  it  is  listed  as 
being  in  "F"  condition.  When  that  item  is  inducted  into 
repair  by  a  TIR  reporting  DOP,  the  condition  code  is  cheuiged 
to  "M".  If  the  carcass  is  sent  to  a  non-TIR  reporting  DOP, 
it  is  reclassified  "M"  condition  when  it  is  forwarded  from 
the  last  TIR  reporting  activity.  If  the  carcass  is  declared 
irrepareUale ,  a  TIR  reporting  DOP  sends  a  TIR  to  the  ICP 
changing  the  condition  code  to  "H"  emd  the  item  is  deleted 
from  the  appropriate  files.  Mon-'TIR  reporting  DOP's  notify 
the  ICP  via  the  monthly  report  and  the  ICP  manually  makes 
adjusting  entries.  Once  the  Repair  Phase  is  completed,  the 
RFI  asset  is  forwarded  to  a  stock  point  and  the  condition 
code  is  upgraded  to  "A"  condition.  Thus,  the  status  of  a 
particular  repairable  item  at  any  point  in  the  repairadsles 
pipeline  can  be  pinpointed  by  its  condition  code. 

D.  UICP  PROGRAMS 

UICP  program  B04  processes  the  TIR*s  sent  to  SPCC.  The 
program  receives  the  TIR's  and  updates  the  MDF,  DDF  and  PPR 
files.  Additionally  it  accomplishes  the  following: 

a)  calculates  lead  times  for  repair  and  procurement; 

b)  accumulates  demand  and  carcass  return  data; 

c)  accumulates  repair  inductions,  regenerations  and 
disposals ;  euid 

d)  generates  follow-up  inquiries  on  DDF  overdue  records. 


UICP  program  BOl  is  the  requisition  processing  prog:  <  . 
VRxen  a  requisition  is  filled  at  the  point  of  entry  und&. 
the  Area  Supply  Support  Concept ,  the  resulting  issue  is 
processed  at  the  ICP  through  B04.  If  the  stock  point  is 
out  of  stock  or  the  item  is  not  carried,  the  requisition  is 
TIR'ed  to  the  ICP  and  processed  by  BOl.  This  program  bumps 
the  requisition  against  system-wide  stock  availability  and 
the  requisition  is  then  either  passed  by  TIR  to  another 
stock  point  for  issue  or  a  backorder  is  created  in  the 
Document  Status  File  (DSF) .  Then,  the  progreun  provides 
status  on  the  demand  to  the  originator,  updates  the  MDF  with 
a  demand  observation,  and  establishes  a  due-out  in  the  DDF. 

B02  is  the  Plcumed  Requirements  program  and  is  used  to 
update  and  manage  the  PPR  file.  This  program  works  only 
with  non-recurring  demand  such  as  initial  outfitting, 
allowance  increases,  and  planned  overhauls.  BO 2  keeps  track 
of  known  upcoming  system  needs  and  ensures  that  they  are 
taken  into  consideration  as  requirements  when  economic  order 
queuitities  emd  reorder  levels  are  computed. 

E.  THE  LEVELS  PROGRAM 

The  cornerstone  of  the  UlCP  system  is  the  Cyclic  Levels 
and  Forecasting  program  DOl.  The  Levels  program  computes 
economic  order  and  repair  quantities  as  well  as  reorder  and 
repair  points.  This  progreun  determines  when  to  buy  or 
repair  and  how  much  to  buy  or  repair.  The  Levels  program 
is  run  quarterly  and  represents  the  budget  execution 
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strategy  of  management  through  the  establishment  of  inven¬ 
tory  stocking  objectives.  The  goal  of  the  Levels  program 
is  to  set  the  proper  inventory  stocking  and  reorder  levels 
to  maximize  Supply  Material  Availability  (SMA)  at  the 
minimum  possible  cost.  SMA  represents  the  percentage  of 
the  time  that  a  requisition  is  filled  by  the  supply  system 
when  it  is  initially  submitted.  The  current  system-wide 
goal  established  by  the  Naval  Supply  Systems  Command 
(NAVSUP)  is  85  percent.  The  costs  to  be  minimized  are  the 
total  variable  costs  associated  with  an  inventory  system  - 
ordering,  holding  and  stockout  costs.  An  outline  of  the 
Levels  program  for  repairables  follows. 

1.  The  program  draws  its  data  base  from  the  MDF. 

2.  It  sets  the  parameter  values  for  the  various  calcu¬ 
lations.  These  parameters  include  the  minimum  or 
maximum  risk  factor  depending  upon  the  item's  MARK 
classification  (which  will  be  discussed  below) ;  the 
storage  cost;  and  the  specific  probability  distri¬ 
bution  to  be  used  in  the  reorder  point  calculations . 

3.  It  forecasts  the  recurring  demands  and  carcass 
returns  and  updates  estimates  of  the  repair  survival 
rate  and  the  repair  and  procurement  turnaround 
times . 

4.  It  calculates  the  economic  order  quantity,  reorder 
level,  economic  repair  quantity,  and  repair  level. 

5.  It  stores  the  new  calculations ,  forecasts  and  average 
updates  in  the  MDF  and  the  IHF. 

When  determining  the  reorder  level  for  an  item,  the 
Levels  program  selects  from  three  probability  distributions 
based  upon  the  item's  MARK  classification  and  demand 
pattern.  When  demand  is  very  low  or  the  item  is  held  only 
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for  safety  stock,  the  Poisson  distribution  is  used  to 
predict  lead  time  demand  patterns.  For  medium  demand  items, 
the  negative  binomial  distribution  is  used  and  for  high 
demand  or  fast  moving  items  the  normal  distribution  is  used. 

As  mentioned  above,  establishment  of  key  inventory 
par2uaeters,  or  knob  setting,  also  is  dependent  upon  the 
MASK  classification  of  an  item.  Figure  4  illustrates  the 
MARK  classification  system.  The  MARK  system  classifies 
inventory  items  based  upon  demand  pattern  and  unit  costs. 

An  item  with  little  or  no  demand  would  be  designated  MARK  0, 
while  an  item  with  low  cost  but  fast  moving  demand  would 
be  designated  MARK  II,  etc.  Repairable  items  are  all 
treated  as  MARK  II  AND  IV  items  for  UICP  calculations. 

The  UICP  models  for  calculating  economic  order  quanti¬ 
ties  (EOQ)  and  reorder  points  are,  in  general,  modifica¬ 
tions  of  classical  inventory  formulations  as  discussed  in 
Hadley  and  Whitin  [Ref.  5]  auid  implemented  into  the  Depart¬ 
ment  of  Defense  by  [Ref.  6] .  The  following  discussion  will 
outline  the  equations  used  by  the  Levels  program.  The 
derivations  of  the  models  are  presented  in  [Refs.  7,  8]. 

The  repairable  procurement  model  attempts  to  minimize 
the  variable  costs  associated  with  holding  inventory. 

These  costs  are  the  ordering  costs  which  include  the 
administrative  cost  of  placing  an  order;  the  holding  cost 
which  includes  opportunity  cost  of  capital,  obsolescence 
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and  storage  costs;  and  shortage  costs.  The  shortage  costs 
are  the  costs  to  the  supply  system  of  being  out  of  stock 
for  an  order.  While  in  the  closed  military  supply  system 
this  cost  is  not  quantifiable  in  terms  of  dollars  and/or 
material  readiness,  a  shortage  cost  is  imputed  as  a  result 
of  the  budgeting  process.  The  initial  calculation  is  the 
standard  Wilson  EOQ  calculations ,  Q^,  (modified  appropriately 
for  the  repair  problem)  of 


Qw  = 


8  A  (D  -  B) 
I  C 


where:  A  -  ordering  costs, 

B  =  repair  regenerations, 

C  »  replacement  cost  for  the  item, 

D  =*  recurring  demand  for  the  item,  and 
I  =  holding  cost  rate. 

The  "8"  in  the  equation  transforms  the  calculation  into  a 
yearly  cost  since  the  input  variables  D  and  B  are  quarterly 
rates.  The  calculation  (D-B)  represents  "attrition" 
demand,  or  the  anticipated  recurring  demand  observations 
that  cemnot  be  filled  by  the  repair  process .  B  is  the 
product  of  the  carcass  return  forecast  and  the  repair 
survival  rate.  The  repair  survival  rate  (RSR)  is  an 
estimate  of  the  percentage  of  carcasses  entering  the  repair 


process  that  will  survive  emd  be  placed  in  "A"  condition  by 
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the  DOP.  Thus,  through  the  parameter  B,  the  carcass  return 
forecast  (CRF)  plays  a  key  role  in  the  determination  of  the 
order  quauitity.  If  the  CRF  is  too  high,  projecting  that 
more  carcasses  will  be  turned  in  by  customers  them  will 
actually  be  the  case,  then  the  EOQ  quantity  will  be  too  low. 
This  will  cause  too  few  RFI  tinits  to  be  procured  and  possi¬ 
bly  result  in  a  not-in-stock  position.  This  will  drive 
SMA  down  and  force  repairs  on  existing  carcasses  at  premium 
prices  in  terms  of  both  unplanned  repair  contracts  and  high 
priority  transportation  costs.  Alternatively,  if  the  CRF 
is  too  low,  more  carcasses  will  be  returned  than  estimated. 
This  results  in  a  long-supply  position  due  to  inflated  buy 
quantities  and  greater  than  expected  carcasses  returned. 
While  SMA  should  be  high  in  this  situation,  the  penalty 
cost  will  be  an  excessive  investment  in  inventory  and 
associated  greater  than  necessary  holding  costs. 

The  Levels  program  does  not  automatically  make  the 
EOQ  value  the  buy  quantity,  but  imposes  several  constraints 
on  the  qu2uitity  to  protect  against  inordinately  large  or 
small  buys.  This  guards  against  possible  obsolescence  on  a 
long  supply  position  and  an  increased  purchasing  workload 
for  small  EOQ's.  The  actual  buy  quantity,  Q*,  is  determined 

Q*  »  Max  (1,  (D  -  B)  ,  Min  (Q^,  12  (D  -  B)  )  )  . 

The  reorder  point  (RP)  is  taken  to  be  the  sum  of  the 
procurement  problem  variable  and  a  safety  level.  The 
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procurement  problem  variable,  Z,  represents  the  net  assets 
(RFI)  required  to  meet  anticipated  recurring  demands  over 
the  procurement  lead  time  period.  It  is  calculated  as 


Z  *  (D  X  L)  -  (B  X  L)  +  (B  X  T)  , 
where:  Z  «  procurement  problem  varieUsle, 

L  a  procurement  lead  time  in  quarters, 

T  «  repair  turnaround  time, 

D  a  anticipated  recurring  demand  per  quarter,  and 
B  a  repair  regenerations. 

The  safety  level  is  a  function  of  risk  and  the  variance 
of  the  procurement  problem  variable. 

Risk,  as  used  in  the  UICP  repairable  model,  is  defined 
as: 


RISK  = 


_ Q*  I  C  D _ 

(Q*  I  C  D)  +  (4  X  E  F  (D  -  B)  ) 


f 


where:  E  =  military  essentiality  weight, 

P  a  mean  quarterly  requisition  forecast, 

Q*a  constrained  order  quantity,  and 
\  a  assigned  shortage  cost  per  requisition. 

This  is  the  UICP  approximation  of  the  classical  inventory 
model  of  risk  which  yields  the  probability  of  rxinning  out 
of  stock  over  the  procurement  leadtime  period.  The  CRF  is 
represented  in  the  risk  calculation  in  the  repair 


regeneration  factor.  If  the  risk  factor  is  low,  the  reorder 
point  will  be  relatively  high  resulting  in  frequent  reorders 
and  a  high  safety  level.  If  the  risk  factor  is  high,  a 
relatively  low  reorder  point  results  with  a  small  safety 
level.  If  the  CRF  is  low  (more  carcasses  are  returned  than 
expected)  the  risk  factor  will  be  smaller  than  it  should 
be.  This  causes  reorders  to  occur  more  frequently  than  they 
should  thus  leading  to  a  higher  investment  in  safety  stock 
than  would  be  actually  necessary.  On  the  other  hand,  a  CRF 
that  is  too  high  would  result  in  the  opposite  situation  of 
a  dangerously  low  safety  stock  level  and  probable  stockouts. 

The  other  repairables  inventory  control  calculations 
made  by  the  Levels  program  are  the  economic  repair  quantity 
(ERQ)  and  the  repair  level,  both  similar  to  EOQ  and  reorder 
quantity.  The  UICP  system,  however,  considers  the  repair¬ 
able  EOQ  and  ERQ  problems  as  separate  entities  and  the 
calculations  are  "uncoupled",  i.e.  the  calculation  of  one 
does  not  affect  the  calculation  of  the  other.  The  repair- 
eUsle  EOQ  model,  in  fact,  assumes  that  the  CRF  will  indeed 
be  accurate  and  the  inductions  into  the  Repair  Phase  and 
the  subsequent  regenerations  at  the  end  of  the  repair  cycle 
will  occur  on  time  with  certainty. 

The  ERQ  is  determined  as  a  function  of  the  variable 
costs  involved  in  repairing  a  carcass:  cost  to  place  a 
repair  order,  holding  costs  per  unit,  and  backorder  costs 
when  there  is  a  shortage  of  RFI  assets  and  is  subject  to 


several  system  constraints.  A  formulation  similar  to  the 
Wilson  EOQ  model  is  used  to  obtain  the  approximation  of  the 
repair  quantity, 


°wr  -  Y 


3  Aj.  Min  (D,  B) 


where:  *  repair  cost  for  an  item,  and 

Ar  *  cost  to  initiate  repair  action. 

Note  that  the  repair  quantity  equation  takes  on  a  slightly 
different  form.  If  the  forecasted  demands  are  less  than  the 
forecasted  repair  regenerations,  the  forecasted  demand 
figure  will  be  used  in  the  ERQ  calculation  and  there  would 
be  no  purchase  of  new  units  since  repair  will  be  able  to 
meet  all  expected  demands.  If  the  forecasted  demands 
exceed  the  expected  number  of  repair  regenerations,  B  will 
be  used,  and  there  should  be  a  resulting  procurement  action. 

Because  of  the  economics  of  placing  repair  orders  and/ 
or  repairing  too  many  carcasses  at  one  time  (again  possible 
obsolescene) ,  there  are  constraints  placed  upon  ERQ  by  the 
Levels  prograun. 

ERQ  *  Max  (1,  RVC  x  B) 

where:  Q^^^  «  optimal  Wilson  ERQ  determination  above, 
and 


RVC  >  repair  cycle  length  in  quarters. 


The  repair  level  represents  the  predesignated  carcass 
inventory  level  that  should  trigger  a  repair  order  being 
placed  for  a  quantity  of  ERQ  units  to  preclude  rvinning  out 
of  stock.  This  level  is  a  function  of  the  mean  and  variance 
of  repair  turnaround  time  and  the  assumed  probability 
distribution  of  repair  leadtime  and  risk.  The  repair 
turnaround  time  mean  and  variance  parameters  are  determined 
by  the  Levels  program  from  historical  data.  The  probability 
distributions  used  are  the  three  previously  mentioned. 

Risk  in  the  repair  quantity  calculation  is  determined  by 

Qj.*  I  Cj.  D 

“  (Qj.*  I  D)  +  (4  X  E  F  B) 
where:  Qj.*  *  ERQ. 

The  carcass  return  forecast  can  cause  problems  in  initiating 
repair  inductions.  When  the  CRF  is  too  high,  the  risk  will 
be  relatively  lower.  This  means  a  higher  repair  level. 

Since  the  repair  order  will  not  be  initiated  until  that 
level  is  reached,  an  order  will  be  delayed  awaiting  needed 
carcasses  which  are  returning  at  the  actual  lower  return 
rate.  This  may  result  in  the  repairable  pipeline  "running 
dry"  before  more  carcasses  are  inducted  with  the  resulting 
shortfall  in  RFI  assets  from  the  repair  cycle.  If  the  CRF 
is  too  low  the  opposite  effect  will  occur  with  more  money 
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money  being  spent  on  repair  than  is  necessary  to  maintain 
the  desired  SMA. 

F.  SUPPLY  DEMAND  REVIEW 

In  order  to  implement  a  "continuous  review"  model  in  an 
inventory  system,  the  system's  assets  and  requirements  must 
be  tracked.  This  is  accomplished  within  the  UICP  system  by 
the  Supply  Demand  Review  (SDR)  BIO  program.  The  Levels 
program  provides  the  reorder  levels  and  reorder  quantities 
as  inputs  to  SDR.  Besides  the  reorder  quantity  and  reorder 
level  for  an  item,  SDR  requires  two  other  parameters  - 
total  assets  and  requirements.  Total  assets  for  an  item 
include  current  on-hand  and  anticipated  due- ins  within  the 
procurement  lead  time  from  both  repair  (which  includes 
forecasted  carcass  returns)  and  procurement  sources.  Total 
requirements  include  planned  program  requirements,  war 
reserves,  auiticipated  recurring  demands  and  backorders  due- 
out  during  the  procurement  cycle.  SDR  compares  assets 
against  requirements  to  determine  the  net  asset  position. 

If  the  net  asset  position  is  at  or  below  (asset  deficiency) 
the  reorder  point,  a  buy  recommendation  is  initiated.  This 
buy  quantity  is  the  economic  order  quantity  plus  the  asset 
deficiency  quantity.  SDR  is  run  approximately  once  a  week. 
It  does  not  review  the  asset  position  of  every  item  on  each 
run,  but  only  the  items  flagged  by  the  TIR  program  B04. 

BO 4  compares  the  SDR  reorder  point  to  the  item  asset 
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position  as  determined  £rom  the  MDF  and  PPR  files  and  flags 
the  candidate  items  for  processing  by  SDR. 

SDR  buy  computations  can  be  run  in  two  modes,  live  or 
dead.  A  live  SDR  buy  recommendation  is  automatically 
routed  to  procurement  for  action  unless  the  item  manager 
manually  overrides  the  system.  If  a  dead  SDR  is  made  for  an 
item,  the  buy  recommendation  is  routed  to  the  item  manager 
who  must  then  decide  if  the  buy  should  be  submitted  to 
procurement.  In  general,  the  mode  is  determined  by  fiscal 
constraints.  SDR  also  determines  the  allocation  of  the 
buy  quantities  and/or  redistribution  of  existing  stocks 
among  the  stock  points.  The  SDR  procedure  is  graphically 
illustrated  by  Figure  5. 

G.  REPAIR  SCHEDULING 

The  repair  levels  and  ERQs  determined  by  the  Levels 
progreun  are  used  as  the  decision  parameters  for  the  Repair 
Scheduling  program  808  which  also  accesses  the  MDF,  PPR 
and  DDF  files  for  its  data  base.  808  is  run  about  every 
two  weeks  and  makes  a  computation  of  its  asset  position  to 
compare  to  the  repair  level  similar  to  the  computation  in 
the  SDR  process.  808  then  makes  its  repair  induction  and 
redistribution  recommendation  about  NRFI  material.  When 
the  Repair  Scheduling  program  senses  that  the  system  is 
carcass  constrained  < short) ,  it  alters  the  Movement 
Priority  Designator  (MDP)  in  the  MDF.  This  eventually 
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The  Supply  Demand  Review  Procedure  [Ref.  9] 


triggers  a  change  in  the  MRIL  which  the  customer  uses  to 
determine  the  transportation  priority  for  the  carcasses 
upon  turn-in. 


H.  REPAIBABLES  FUNDING 

Before  considering  the  repairables  funding  requirements 

through  the  budgeting  process  of  the  UICP  Stratification 

program  B20,  it  is  important  to  understand  the  fiscal 

structure  currently  associated  with  repairables.  The  Navy 

divides  its  material  stocks  into  two  major  classifications 

as  defined  by  Wooten  [Ref.  10]: 

Principal  Items  are  major  assemblies  such  as  aircraft 
engines,  complete  radar  sets,  gun  mounts  and  ammunition. 
Acquisition  of  this  material  is  funded  by  the  procurement 
appropriations  -  such  as  OPN,  WPN,  and  APN. 

Secondary  Items  are  spare  parts,  replacement  assemblies, 
cuid  consumable  supplies.  Examples  are  tools,  repairaUsle 
assemblies,  hardware,  fuel,  clothing  and  the  like. 

Principal  items  are  funded  through  the  appropriations  cited, 

while  secondary  items  are  funded  through  two  possible 

sources.  Traditionally,  all  repairable  items  were  fvmded 

by  the  appropriations  accounts  that  also  buy  principal 

items.  The  other  source  of  funds  for  secondary  items  is 

the  Navy  Stock  Fund  (NSF) . 

The  NSF  is  a  revolving  fund  managed  by  NAVSUP.  This 
means  that  the  NSF  consists  of  money  and/or  stock  owner¬ 
ship.  When  stock  is  issued  to  customers,  the  stock  portion 
of  the  NSF  is  reduced  and  the  funds  portion  is  increased  by 
an  equal  amount.  These  funds  are  then  "available"  through 
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the  budgeting  process  to  the  ICP  or  stock  point  to  purchase 
more  stock  from  vendors.  This  increases  the  stock  in  the 
account  and  reduces  the  available  cash  balance.  While  in 
theory  this  is  a  closed  system,  therc^  are  losses  to  the  NSF 
which  are  the  result  of  material  loss,  pilferage  and 
transportation  charges.  These  financial  losses  are  made  up 
through  surcharges  on  customer  sales.  The  congressional 
budgetary  process  provides  the  infusion  of  funds  when  the 
NSF  operating  base  is  increased  due  to  an  enlarged  scope  of 
operations.  Such  an  infusion  of  funds  occurred  on  1  April 
1981  when  non-aviation  depot  level  repairables  managed  by 
spec  were  changed  from  APA  funding  to  NSF  funding  for  a 
three  year  test  period.  APA,  or  Appropriations  Procurement 
Account,  funding  means  that  the  repairables  were  procured 
with  funds  appropriated  annually  from  the  major  budget 
claimants  and  were  essentially  free  to  the  repairable  item 
end  users.  Figure  6  depicts  the  repairables  within  the  NSF 
funding  picture. 

Funding  repairables  from  APA  appropriations  requires 
annual  budget  submissions  which  are  followed  by  a  fixed 
appropriation  to  be  spent  in  the  designated  fiscal  year. 
Under  the  new  system  of  NSF  funding,  repairable  budgets 
are  also  submitted  to  the  NSF  manager,  NAVSUP,  but  they 
are  in  terms  of  the  obligation  authority  required  to 
execute  an  NSF  funded  operation.  The  approved  NSF  budget. 
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called  an  approved  apportionment,  is  provided  to  the 
recipient  in  terms  of  estimated  customer  NSF  sales,  NSF 
obligation  authority  of  the  recipient  and  a  deviation  (the 
difference  between  anticipated  sales  and  obligation 
authority) .  NAVSUP  then  issues  the  apportioned  funds  in 
quarterly  allocations. 

There  are  significant  advantages  of  NSF  funding  over 
other  methods  of  funding  in  the  repairables  area.  First, 
the  NSF  budget  holder  can  obtain  additional  obligation 
authority  if  sales  exceed  the  anticipated  levels  originally 
estimated.  The  only  limitation  is  that  the  budget  holder's 
apportionment  can  be  increased  only  up  to  a  level  where 
there  is  still  the  original  deviation  between  obligation 
authority  and  the  new  sales  figures.  The  NSF  obligation 
authority  augmentation  procedure  is  therefore  simpler  than 
an  augmentation  request  to  a  specific  appropriation  account 
because  the  justification  is  automatically  provided  by 
increased  customer  sales.  The  second  distinct  advantage  of 
NSF  funding  of  repairables  is  that  the  ICP  is  allowed  to 
decide  how  to  allocate  the  obligation  authority  between 
repair  and  procurement.  Under  the  appropriation  funding 
procedures,  there  are  separate  appropriations  for  repair 
euid  purchase.  Therefore,  if  the  CRF  is  too  large  when  the 
funds  are  originally  requested,  there  could  be  a  large 
reserve  of  repair  money  with  few  carcasses  to  repair  (again 
carcass  constrained)  with  the  purchase  funds  exhausted 
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early  in  the  fiscal  year.  If  the  CRF  was  too  small  the 
opposite  situation  would  occur. 

The  change  in  funding  of  repairedsles  also  affects 
customers  from  a  financial  point  of  view.  Prior  to  1  April 
1981,  all  non-aviation  DLR's  were  "free"  to  the  customer 
because  of  the  APA  funding.  After  that  date  customers  were 
required  to  pay  for  RFI  units  with  appropriated  funds. 

The  benefits  expected  to  be  derived  from  the  DLR-NSF 
test  are: 

(1)  improved  supply  readiness  because  of  more 
budgeting  flexibility, 

(2)  improved  carcass  turn-in  rates, 

(3)  more  timely  turn  in  of  carcasses, 

(4)  reduction  in  inventory  investments  due  to 
improved  carcass  availability,  and 

(5)  higher  fill  rate  of  entry  point  repairable  item 
requisitions. 

Items  (4)  and  (5)  are  natural  consequences  of  improved 
carcass  turn-in  rates.  This  is  to  be  accomplished  through 
a  two-price  system  for  repairable  requisitions  and  an 
improved  carcass  tracking  program.  When  a  customer  submits 
a  requisition  for  a  repairable  item,  he  will  be  charged  a 
net  price  which  is  based  upon  the  repair  cost  of  the  iter?.. 
The  net  price  runs  approximately  25-30  percent  of  the 
replacement  price.  If  no  carcass  has  been  received  from 
an  activity  seventy-five  days  after  the  initial  requisition 
data,  an  inquiry  is  sent  to  the  customer  by  the  ICP.  If 
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there  is  not  satisfactory  follow-up  action  by  the  customer 
or  carcass  turn-in  within  twenty-one  days  after  that,  the 
charge  to  the  customer  is  increased  to  a  full  replacement 
price  plus  the  NSF  surcharge  cost.  This  is  known  as  the 
standard  price  and  is  also  charged  to  a  customer  who  does 
not  have  a  carcass  to  turn  in  initially  for  a  recurring 
demand . 

I.  STRATIFICATION 

The  UICP  Stratification  (or  Strat)  progreun  B20  deter¬ 
mines  the  budgetary  requirements  necessary  to  support  the 
UICP  wholesale  inventory  system.  For  the  repairables 
operation,  B20  estimates  these  funding  requirements  as  a 
function  of  key  inventory  control  variables  such  as  demand 
forecasts,  carcass  return  rates,  RSR,  repair  prices, 
replacement  prices,  procurement  lead  times  and  assets 
available  over  a  two  year  time  horizon.  This  process  then 
determines  the  funds  required  to  support  the  available 
assets  and  to  procure  the  replacement  units  needed  to  fill 
the  gap  between  assets  and  requirements.  Strat  is  run  in 
March  and  September  every  year  to  coincide  with  the  budget 
cycle  and  provides  the  baseline  for  the  procurement  and 
repair  budgets  submitted  by  the  ICP. 

J.  CONCLUSION 

The  above  discussion  has  highlighted  the  critical  role 
of  the  carcass  return  forecast  in  the  repaireUales  inventory 


42 


control  process.  The  CRF  is  at  the  base  of  both  procurement 
and  repair  levels  computations.  While  the  CRF  is  only  a 
forecast  or  "best  guess"  of  anticipated  carcasses  returning 
to  the  repairables  cycle,  it  is  important  that  the  forecasts 
accurately  reflect  the  actual  returns.  The  thesis  will  now 
present  various  forecasting  schemes  and  tests  of  their 
effectiveness  using  actual  SPCC  data. 


III.  THE  MODELS 


The  criteria  for  a  good  forecasting  method  is  that  the  1 

model  closely  follow  actual  observations  and  quickly  adjust 
to  trends.  To  do  this  the  model  should  be  closely  aligned 
to  the  actual  underlying  process  that  generates  the  observed 

I 

values.  To  select  the  appropriate  forecasting  model,  j 

I 

Chaunbers,  Mullick  and  Smith  (Ref.  12]  suggest  that  the 
following  factors  be  considered: 

a)  the  relevance  and  availability  of  historical  data, 

b)  the  degree  of  accuracy  desired, 

c)  the  time  period  over  which  to  forecast,  and 

d)  the  cost/benefit  of  the  forecast  to  the  system.  | 

I 

The  main  consideration  is  to  make  the  best  use  of  available  ^ 

data.  For  example,  the  best  forecasting  technique  available 
may  be  prohibitively  expensive  because  of  the  cost  of  re- 

j 

structuring  the  data  collection,  storage  and  retrieval 

I 

systems.  Or  the  best  forecasting  method  may  require  non-  j 

existent  information.  | 

The  forecasting  technique  should  be  one  that  achieves  j 

system-wide  inventory  objectives  at  minimum  cost.  These 

costs  would  consist  of  the  cost  to  collect  the  data  and  | 

I 

actually  make  the  forecast,  cost  of  holding  inventories, 
distribution  system  costs,  the  cost  of  running  out  of  stock, 
etc.  These  costs  are  difficult,  if  not  impossible,  to 
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collect  and  identify  in  a  study  of  this  scope.  Therefore, 
the  only  MOE's  used  in  this  study  deal  with  forecast  error 
measurement.  We  assume  that  small  forecast  errors  are 
consistent  with  a  high  level  of  system  supply  effectiveness. 
Also,  the  cost  of  data  collection  and  storage  used  for  each 
technique  is  not  addressed. 

This  study  considers  two  types  of  models:  autoregressive 
and  causal.  An  autoregressive  model  as  defined  by  Makridakis 
and  Wheelwright  [Ref.  131  : 

...is  a  form  of  regression,  but  instead  of  the  dependent 
variable  (the  item  to  be  forecast)  being  related  to 
independent  variables,  it  is  related  to  past  values  of 
itself  at  varying  time  lags.  Thus  an  autoregressive  model 
would  express  the  forecast  as  a  function  of  previous 
values  of  that  time  series. 

A  causal  model  is  defined  by  Chambers,  Mullick  and  Smith 
[Ref.  14]  as  a  "model  of  the  system  which  captures  the  facts 
and  logic  of  the  situation."  The  following  two  sections 
will  deal  first  with  the  autoregressive  models  and  then  the 
causal  models. 

Because  of  the  availsdaility  of  only  eight  quarters  of 
data  from  the  IHF,  the  models  are  examined  over  that  period 
of  time.  The  first  four  quarters  are  used  to  generate 
starting  conditions.  This  obviously  limits  the  models  that 
can  be  used.  Because  of  the  brief  amount  of  data  available 
to  develop  the  model  parameters  and  to  analyze  forecasting 
effectiveness,  all  results  of  this  thesis  have  to  be  viewed 
with  caution.  The  results  should  serve  as  the  approximate 


worth  or  relationship  of  the  forecasting  methods  on  the 
particular  data  used.  The  short  time  horizon  also  limits 
the  models  that  are  available  for  analysis.  Time  series 
models  like  Box-Jenkins,  for  example,  cannot  be  used. 

One  further  assumption  in  the  use  of  the  following  models 
and  the  study  in  general  is  that  the  recurring  demand  fore¬ 
casting  (RDF)  technique  is  reliable.  The  UICP  RDF  model 
used  by  SPCC  is  an  exponential  smoothing  model  with  filters 
(the  same  model  as  described  below  for  carcass  return 
forecasting).  The  UICP  RDF  method  is  discussed  in  [Refs. 

15,  16]. 

A.  AUTOREGRESSIVE  MODELS 

1.  SPCC  Exponential  Smoothing  (SPCC) 

The  model  for  forecasting  carcass  returns  currently 
in  effect  in  the  UICP  system  is  exponential  smoothing  with 
filtering.  The  model  is: 

CRF^  =  a  X  (ACR^_j^)  +  (1-a)  x  CRF^_j^ 

where;  CRF^  =  carcass  return  forecast  for  period  t, 

ACR^  =  actual  carcass  returns  for  period  t,  and 
a  =  smoothing  constant. 

The  forecast  for  item  i  for  period  t  is  a  convex  linear 
combination  of  the  observed  carcasses  returned  in  period  t-1 
and  the  forecast  for  period  t-1.  This  method  allows  the 
most  recent  observations  to  play  a  key  role  in  forecasting  a 
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new  value  while  relying  upon  the  steadying  influence  of  past 
performance  brought  forward  through  the  previous  forecast. 
When  the  new  forecast  is  generated,  it  replaces  the  previous 
forecast.  One  characteristic  of  pure  exponential  smoothing 
models  is  that  the  forecast  is  slow  to  catch  up  with  current 
trends  or  shifts  in  the  pattern  of  carcass  returns  because 
of  the  weight  of  past  performance  on  the  forecast.  The  SPCC 
model  includes  filters  to  make  adjustments  to  the  forecast. 

The  calculations  that  are  used  in  the  filtering  pro¬ 
cess  are  also  determined  through  exponential  smoothing. 

MAD^  =  a  X  |ACR^  -  CRF^  |  +  (1-a)  x  MAD^_j^ 

where:  MAD^  =  mean  adjsolute  deviation  for  period  t. 

Theoretically,  when  the  population  of  observations  comes 
from  a  normal  distribution  the  mean  absolute  deviation  para¬ 
meter  (defined  as  an  expected  value)  is  approximately  1.25 
times  the  standard  deviation.  It  measures  the  expected 
absolute  deviation  of  actual  carcass  returns  from  the  mean. 
In  the  SPCC  model  the  mean  is  replaced  by  the  CRF  and 
expected  value  is  estimated  by  exponential  smoothing.  The 
first  filter  looks  for  excessively  large  or  small 
observations.  Limits  are  set  up  around  the  carcass  return 
average  or  CRF.  These  limits  are  six  standard  deviations 
or  7.5  X  MAD.  If  the  observation  for  a  particular  quarter 
is  outside  these  boundaries,  that  observation  is  not  used  to 
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compute  a  new  CRF,  the  previous  CRT  is  retained  without 
change  (in  effect  the  smoothing  constant  is  set  to  zero) . 

If  the  observations  are  outside  the  limits  in  the  Scune 
direction  (either  high  or  low)  for  two  consecutive  quarters, 
a  step  increase  calculation  produces  the  new  CRF: 

ACR^  ,  +  ACR^  ^ 


and  a  new  MAD  is  calculated  from  the  equation 
MAD^  =  1.386  X  (CRF^)*^^® 

New  control  limits  are  established  in  the  following  quarter 
and  the  procedure  continues. 

A  second  type  of  filter  in  the  SPCC  model  detects 
trending,  or  the  tendency  of  the  carcass  return  observations 
to  be  either  increasing  or  decreasing.  Trending  is  tested 
with  the  following  ratio: 

2  X  (ACR^_j^  +  ACR^_2) 

ACR.  ,  +  ACR.  -  +  ACR.  ,  +  ACR.  . 
t-1  t-2  t-3  t-4 

If  the  ratio  is  within  the  limits  [0.9,  1.1],  the  smoothing 
constant  a  is  set  to  0.1.  Otherwise  a  =  0.3.  This  allows 
the  most  current  observations  to  have  a  greater  influence  on 
the  CRF.  While  the  CRF  will  still  lag  behind  au  actual 
trend  with  a  »  0.3,  the  CRF  will  catch  up  at  a  faster  rate 
than  when  a  «  o.l. 
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Because  only  the  current  CRF  is  retained  by  the  UICP 
system,  the  SPCC  exponential  siiKSothing  with  filtering  pro¬ 
gram  has  been  included  in  this  project  to  recreate  the 
forecasts  over  the  two  year  period  this  study  covers.  The 
progr2un  written  with  the  2d3ove  guidelines  to  produce  the 
SPCC  forecasts  is  called  TSPCC  Fortran. 

2.  Exponential  Smoothing  (ES? 

This  model  is  similar  to  the  UICP  exponential  smooth¬ 
ing  model  except  that  no  filtering  is  involved: 

CRP^  *  a  X  ACR^_j^  +  (1-a)  x  CRP^_j^  , 

where:  CRF^  =  carcass  return  forecast  for  period  t, 

ACR^  *  actual  carcass  returns  for  period  t,  and 
a  »  smoothing  constant. 

This  model  was  programmed  as  TES  Fortran.  The  simulation 
was  run  for  a  complete  cycle  through  the  eight  quarters  for 
each  value  of  the  smoothing  constant  a  ranging  from  .05  to 
1.0  in  increments  of  .05.  This  was  done  to  provide  an 
indication  of  which  weight  a  did  the  best  job  overall 
considering  the  actual  SPCC  data. 

When  a  «  1.0,  the  previous  observations  are  elimi¬ 
nated  from  playing  any  part  in  the  forecasting  scheme.  This 
method  is  known  in  the  literature  as  the  "naive"  forecasting 
method  where: 

CRF^  «  ACR^_j^. 
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3.  Moving  Average  (MA) 


The  moving  average  forecasting  model  considers  only 
the  past  n  quarters  and  gives  equal  weight  to  each 
observation.  Unlike  the  exponential  smoothing,  the  moving 
average  model  is  not  affected  by  all  past  observations, 
but  truncates  the  historical  data  at  a  predetermined  point. 


CRF 


t 


ACR 


t-i 


n 


where:  CRF^  *  carcass  return  forecast  in  period  t, 

ACR^  =  actual  carcass  returns  in  period  t,  and 

n  =  number  of  past  periods  included  in  the 
calculation. 


The  program  written  to  produce  moving  average  forecasts  is 
TMA  Fortran.  The  model  was  run  with  n  *  2,  3,  4.  The  fewer 
the  number  of  quarters  averaged,  the  more  easily  a  trend  can 
be  captured.  Conversely,  if  a  single  observation  is  an 
outlier  or  incorrect,  it  has  a  dreimatic  effect  on  the 
forecast.  According  to  Makridakis  and  Wheelwright  [Ref.  17] , 
"the  more  the  randomness,  the  longer  (should  be)  the  moving 
average."  This  argues  in  favor  of  a  longer  period  being 
taken  into  consideration  in  the  averaging  process. 

4.  Moving  Least  Squares  (MLS) 

The  moving  least  squares  forecasting  model  is 
similar  to  the  moving  average  model  in  that  the  current 
forecast  is  a  function  of  the  last  n  time  periods.  The 
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difference  is  that  each  point  is  not  given  equal  weight,  but 
combined  by  means  of  the  least  squares  method.  Then  the 
least  squares  line  is  projected  one  quarter  beyond  the  input 
data  to  arrive  at  the  forecasted  value.  The  algorithm  for 
the  moving  least  squares  method  is: 

CRP^  »  a  +  (b  X  t) 

where:  CRF^  »  carcass  return  forecast  in  period  t, 
a  *  constant  or  intercept  term, 
b  s  slope  of  regression  line,  and 
t  =  period  number  to  be  forecast. 

The  input  to  the  least  squares  formulation  to  obtain  the  two 
parameters  is: 

X  Y 


1 

ACRi 

2 

• 

ACR2 

• 

• 

n 

• 

• 

where  X  is  the  explanatory  variable  and  Y  is  the  dependent 
variable.  The  n  represents  the  number  of  periods  included 
in  the  calculation.  For  example,  if  the  method  was  pre-* 
dicated  upon  the  previous  four  quarters ,  n  would  equal  4 . 
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Once  the  least  squares  line  has  been  determined,  the  fore¬ 
cast  is  obtained  by  setting  t  =  n  1.  The  parameters  for 
the  least  squares  procedure  are  determined  as  follows: 


b  = 


n  X  (X.  X  Y.))  -  (  f  X. )  X  (  2  Y.] 

i^l  ^  ^  i=l  ^  i=l  ^ 


and 


^  ^ 
2v  /  ^  2 


n  X  (  y  x/)  -  (  £  X  ) 
i=l  ^  i=l  ^ 


a  = 


.4  ^  <4  X,, 


Makridakis  and  Wheelwright  (Ref.  18]  discuss  the  least  squares 
approach: 

This  approach  to  estimating  the  parameter  values  in  an 
equation  minimizes  the  squares  of  the  deviations  that 
result  from  fitting  that  particular  model.  For  example, 
if  a  trend  line  is  being  estimated  to  fit  a  data  series, 
the  method  of  least  squares  estimation  could  be  used  to 
minimize  the  mean  squared  error.  This  would  give  a  line 
whose  estimated  values  would  minimize  the  sum  of  squares 
of  the  actual  deviations  from  that  line  for  the  historical 
data. 

The  model  was  run  with  n  =  2,  3  and  4.  One  advantage  of  this 
method  is  that  it  detects  trends  rapidly.  This,  however, 
could  be  a  drawback  if  some  of  the  data  points  were  spurious. 
The  larger  the  value  of  n,  the  slower  the  least  squares  model 
will  be  to  recognize  new  trends  and  the  less  sensitive  the 
model  will  be  to  bad  data. 

The  program  written  to  calculate  the  least  squares 
forecast  is  TMLS  Fortran.  ."Ji  example  of  the  moving  least 
squares  method  is  provided  as  Appendix  A. 
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5.  Adaptive  Response  Rate  (AJUt) 

The  adaptive  response  rate  model  is  suggested  by 

Makridakis  and  Wheelwright  [Ref.  19]; 

Adaptive-response- rate  single  exponential  smoothing 
(ARRSES)  has  an  advantage  over  single  exponential  smooth¬ 
ing  —  it  does  not  require  specification  of  a  value  for  a. 
This  characteristic  is  particularly  attractive  when 
several  hundreds  or  even  thousands  of  items  require 
forecasting.  Additionally,  this  method  can  change  the 
value  of  a,  on  an  on-going  basis  when  changes  in  the 
pattern  of  the  data  have  made  the  initial  ol  value  no 
longer  appropriate.  ARRSES  is  adaptive  in  the  sense  that 
the  value  for  ct  will  change  automatically  when  there  is 
a  change  in  the  basic  pattern  requiring  a  different  a. 

This  particular  method  appears  suited  to  the  SPCC  forecast¬ 
ing  situation  with  such  a  variety  of  items  managed.  The 
algorithm  for  the  adaptive  response  rate  model  is: 


CRF.  ..  =  a.  X  ACR.  +  (1  -  a,  )  x  CRF. 
t+i  t  t  t  t 


with; 


a, 


t+1 


M. 


E^  *  S  X  +  (1  -  S)  X  , 


a  S  X  1  e^  1  +  (1  -  6)  X 


et  “  ACR^  -  , 

0  ^  _<  1  and  0  S  £  1 
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where:  CRF^  =  carcass  return  forecast  for  period  t, 

ACR^  *  actual  carcass  returns  for  period  t, 

=  smoothing  constant  for  period  t, 

e^  =  forecast  error  for  period  t, 

=  smoothed  forecast  error  for  period  t, 

M.  =  absolute  smoothed  forecast  error  for 
period  t ,  and 

8  =»  smoothing  constant  for  error  terms. 

There  are  two  smoothing  constants  in  this  algorithm,  ct  and 
3.  For  this  model  3  was  arbitrarily  set  to  .2.  The  other 
smoothing  value  fluctuates  dynamically  as  described  above. 
This  model  is  predicated  on  a  being  allowed  to  vary  based 
upon  the  performance  of  the  previous  forecasts  thus  adjusting 
for  trends.  The  adjustable  characteristic  of  a  makes  this 
model  different  from  the  exponential  smoothing  model,  and, 
in  a  sense,  performs  a  filtering  of  the  data.  One  drawback 
is  that  more  information  must  be  stored  in  computer  memory. 
The  program  written  for  this  model  is  TARR  Fortran. 

B .  CAUSAL  MODELS 
1.  Regression 

The  regression  forecasting  models  tie  carcass 
returns  (the  dependent  variable)  to  a  collection  of  explana¬ 
tory  variables  (the  independent  variable)  such  as  past  period 
recurring  demands.  The  algorithm  takes  the  familiar  form: 
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Y  »  BX  +  u 


where:  Y  »  dependent  variable  vector, 

X  =*  independent  variable  matrix, 

B  *  coefficients  vector,  and 
u  =  stochastic  disturbance  vector. 

The  estimating  technique  used  is  multiple  linear  regression. 
This  produces  maximxim  likelihood  estimators  for  the  model 
coefficients  when  it  is  further  assvuned  that  the  stochastic 
disturbance  vector  u  is  distributed  as  the  multivariate 
normal  with  zero  meam  and  covariance  matrix  i.e. 

u  '\-  N(E(u)  ,  Q)  =  N(0,  a^I)  . 

With  this  model  and  the  above  assumptions  concerning  the 
stochastic  disturbance  term  and  non-stochastic  X  terms,  the 
coefficients  are  derived  in  accordance  with  the  Gauss-Markov 
Theorem.  As  Intriligator  [Ref.  20]  points  out,  the  coeffi¬ 
cients  "are  linear  and  unbiased  estimators  that  are  the 
best  of  all  linear  unbiased  estimators;  i.e.  the  estimators 
have  minimum  variance  within  the  class  of  linear  unbiased 
estimators . " 

The  coefficient  vector  solution  becomes; 

-1 

B  »  (X'X)  X'Y. 

The  carcass  return  forecast,  Y,  is  tcdcen  to  be 
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The  regression  model  (coded  as  TREGRESS  Fortran)  was 
used  with  two  different  types  of  explanatory  variables, 
recurring  demands  and  requisition  advice  codes.  All  regres¬ 
sions  were  run  on  the  IBM  3033  VMS  batch  processing  system 
using  the  Statistical  Analysis  System  (SAS)  to  accomodate 
the  large  X  data  matrix  (30,044  x  2).  SAS  allowed  the 

regressions  to  be  calculated  with  or  without  intercepts, 

2 

and  It  provided  R  ,  standard  errors  of  regression,  Durbin- 
Watson  statistics,  t-statistics  and  various  other  statistics 
that  are  helpful  in  evaluating  regression  models, 
a.  Recurring  Demand  Regression  Models 

The  first  set  of  regression  models  uses  aggre¬ 
gate  demands  per  period  as  the  independent  variable.  The 
general  model  is: 

CRF^  .  6^  S^RDF^  .  . . 

where:  CRF^  =  carcass  return  forecast  in  period  t, 

RDF^  =  recurring  demand  forecast  in  period  t, 

ARD^  *  actual  recurring  demand  in  period  t, 

6^  =  intercept  term  (when  included) ,  and 

3.  =  weighting  coefficient  for  the  ith 
independent  variable. 

As  discussed  in  the  introduction,  a  carcass 
return  does  not  occur  unless  there  is  a  demand  (i.e.  a  unit 
has  failed  thus  setting  the  repair  cycle  in  motion) .  The 
date  of  the  demand  and  the  receipt  of  the  carcass,  however. 


do  not  necessarily  coincide.  The  carcass  could  be  turned  in 
with  the  requisition  for  the  replacement  item  or  turned  in  at 
some  later  date.  This  is  the  relationship  that  the  regres¬ 
sion  model  attempts  to  identify.  The  situation  is  further 
complicated  by  the  fact  that  not  all  carcasses  are  turned 
back  in  to  the  system.  Therefore,  the  cumulative  total  of 
carcass  returns  over  time  should  be  less  than  100  percent 
of  total  demands  over  that  same  period. 

It  is  important  to  note  that  some  carcasses  are 
turned  in  with  the  demand.  This  means  that  a  carcass  return 
forecast  for  period  t  should  include  some  carcasses  that 
resulted  from  actual  demands  also  in  period  t.  Since  the 
demands  for  period  t  are  a  random  variable,  they  must  be 
forecasted  as  an  input  to  make  the  CRF  model  work  (where  the 
coefficient  of  the  current  quarter  explanatory  variable  is 
other  than  zero) .  When  those  resulting  regression  models 
were  synthesized,  the  recurring  demand  forecast  was  used  to 
estimate  carcass  returns  for  the  current  period.  The  recur¬ 
ring  demand  forecasting  scheme  used  was  the  UICP  model  SPCC 
currently  employs.  This  model  is  identical  to  the  exponen¬ 
tial  smoothing  with  filtering  model  used  by  SPCC  to  calculate 
carcass  returns. 

The  regression  model  for  forecasting  carcass 
returns  based  upon  recurring  demand  was  suggested  by  SPCC 
Code  340  and  was  proposed  by  SPCC  Code  346  as  an  "offset" 
model. 
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b.  Advice  Code  Regression  Models 

The  regression  model  was  also  used  to  investi¬ 
gate  the  use  of  advice  codes  as  explanatory  variables. 

Each  requisition  has  an  advice  code  which  provides  amplify¬ 
ing  information  on  the  transaction.  The  advice  codes  that 
apply  to  recurring  demands  as  defined  below  are  taken  from 
[Ref.  21]. 

5A  -  Replacement  certification.  Requested  item  is 
required  to  replace  a  mandatory  turn-in  repairable 
which  has  been  surveyed  as  missing  or  obviously 
damaged  beyond  repair. 

5G  -  Exchange  certification.  Requested  item  is  a 
mandatory  turn-in  repairable  for  which  an  unservice¬ 
able  unit  will  be  turned  in  on  an  exchange  basis  under 
the  same  document  number  as  that  used  in  the 
requisition. 

5S  -  Remain- in-place  Certification.  Requested  item  is 
a  mandatory  turn-in  repairable  for  which  an  unservice¬ 
able  unit  will  be  turned  in  on  an  exchange  basis  after 
receipt  of  a  replacement  (serviceable)  unit.  Turn-in 
will  be  on  the  same  document  number  as  that  used  in  the 
replacement  requisition. 

5X  -  Stock  replenishment  certification.  Requested  item 
is  required  for  stock  replenishment  of  a  mandatory  turn- 
in  repairable  for  which  unserviceable  units  have  been 
or  will  be  turned  in  for  repair. 

To  summarize,  the  5A  advice  code  means  that  the 

requisition  does  not  have  a  tum-in.  These  demands  will  not 

be  included  in  the  explanatory  variable  matrix  since  they  do 

not  account  for  any  carcass  returns.  5A  requisitions 

represent  a  portion  of  the  recurring  demands  used  in  the 

previous  regression  model  that  do  not  generate  a  return, 

thus  part  of  the  cause  of  the  ratio  of  carcass  returns  to 
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recurring  demands  being  less  than  one.  Advice  code  5G 
indicates  that  a  carcass  will  be  returned  at  the  Scune  time 
the  requisition  is  submitted.  While  this  does  not  always 
occur,  the  majority  of  5G  carcasses  should  return  within  one 
period  of  the  original  demand.  The  5S  advice  code  indicates 
that  the  failed  part  will  remain  installed  in  the  next 
higher  assembly  which  will  continue  to  work  in  some  degraded 
manner  until  the  replacement  item  is  received.  At  that  time 
the  failed  unit  will  be  pulled  from  the  assembly  and  returned 
to  the  supply  system.  The  5S  advice  code  item  then  essen¬ 
tially  ass\imes  the  turn-in  pattern  of  normal  advice  code 
5G  requisitions.  The  fourth  advice  code,  5X,  indicates 
that  an  intermediate  level  maintenance  facility  (e.g.  a 
tender  or  shipyard)  has  issued  the  repairable  item  from  its 
inventory  to  the  customer  and  that  it  is  ordering  to  replace 
the  stock.  The  5X,  in  effect,  "masks"  the  true  recurring 
demand  advice  code  which  cannot  be  determined  from  the  5X 
requisition.  This  creates  two  problems.  One  is  that  the 
carcass  return  could  vary  from  no  returns  to  all  (i.e. 
original  demand  was  5A)  to  a  long  wait  for  the  carcass 
Ci.e.  original  demand  was  5S) .  This  makes  the  carcass 
tracking  program  very  difficult  to  implement  for  5X  demands. 
The  other  problem  is  that  the  original  requisitioner  turns 
the  carcass  in  to  the  supply  system  citing  the  document 
number  of  his  requisition.  The  facility  that  issues  the 
item  to  the  original  requisitioner  reorders  the  item  for 
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stock  using  its  own  requisition  number  citing  advice  code  5X. 
Therefore,  the  requisition  number  in  the  ICP  due-in  file 
created  as  a  result  of  the  stock  replenishment  action  and 
the  requisition  number  on  the  actual  turn-in  item  do  not 
match.  Thus,  the  issue  and  subsequent  carcass  receipt  can 
not  be  properly  paired  nor  the  turn-in  waiting  times 
definitely  established. 

The  purpose  of  regression  analysis  is  to  identify 
the  underlying  relationship  of  demands  by  advice  code  to 
carcass  returns.  Figure  7  illustrates  the  time-lag  layering 
effect  of  the  carcass  returns  as  a  function  of  recurring 
demands  with  a  mix  of  advice  codes.  An  example  of  the 
regression  model  relating  carcass  returns  to  demands  by 
advice  codes  is 

CRPt  =  +  03A5S^_3  +  +  B5A5X^_.3  +  .  . 

where:  CRF^  ®  carcass  return  forecast  for  period  t, 

F5G.  =  forecasted  advice  code  5G  demands  in 
period  t, 

A5G^  =  actual  advice  code  5G  demands  in  period  t, 

A5S^  =  actual  advice  code  5S  demands  in  period  t, 

ASX^  =  actual  advice  code  5X  demands  in  period  t, 

Bq  =  intercept  term  (if  applicable) ,  and 

Bj  =  coefficient  for  the  ith  advice  code  demand 
in  period  t-k. 
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Figure  7.  Theoretical  Time-Lag  Layering  Effect  of  Carcass 
Returns  as  a  Function  of  Demands  by  Advice  Code 


2.  Time  Lag  (LAG) 

The  time-lag  model  uses  the  cumulative  distribution 
of  carcass  returns  to  predict  the  number  of  carcasses  return¬ 
ing  in  any  one  period.  The  key  element  of  this  approach  is  to 
identify  the  proper  distribution  of  carcasses  returning  to 
the  system.  Information  concerning  carcass  turn-in  times 
has  already  been  collected  from  the  SPCC  THF  file  for  a  study 
of  the  proposed  NSF  funding  of  DLR  items.  The  appropriate 
information  from  [Ref.  22]  is  contained  in  Figure  8  and  used 
to  determine  the  desired  carcass  return  distribution.  The 
data  from  [Ref.  22]  was  collected  under  the  following 
specifications : 

Data  for  constructing  the  distributions  were  extracted 
from  the  SPCC  Transaction  History  File  for  the  period 
November  1975  through  October  1977.  The  time  measured 
is  the  time  between  the  Julian  Date  of  the  document  and 
the  transaction  date  of  the  TIR.  Identification  by 
Atlantic,  Pacific  and  Shore  was  determined  by  the  Service 
Designator  Code  of  the  document.  As  a  result,  any  ship 
issue  or  turn-in  document  which  was  initiated  with  a 
Service  Designator  Code  of  "N"  is  compiled  under  "Shore." 
Carcass  returns  were  identified  by  Condition  Code  "F"  in 
the  document.  Condition  Code  "A"  turn-ins  are  contained 
in  "Other  Returns."  Although  a  distribution  of  turn-ins 
by  priority  was  constructed,  very  few  of  the  TIR's  for 
turn-ins  contained  a  priority  designator. 

For  the  purpose  of  this  study,  the  cumulative  totals  of 

returns  by  all  Service  Designation  Codes  was  used  because  no 

such  distinction  is  made  by  the  SPCC  forecasting  models.  The 

data  on  "Other  Returns"  was  not  used. 

In  order  to  build  the  model,  the  assumption  was  made 
that  the  demands  within  each  of  the  periods  listed  in  Figure  8 
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CARCASS  RETURNS 
DOCUMENT  IDENTIFIER  D6A 


are  distributed  uniformly.  Therefore,  the  average  demand 
occurs  on  the  45th  day  of  the  quarter.  If  a  demand  occurs 
very  early  in  the  quarter  there  is  a  greater  chance  that  a 
carcass  will  be  returned  within  the  period  than  if  a  demand 
occurs  at  the  end  of  the  quarter.  These  two  situations 
would  tend  to  net  out  to  the  45  day  average  available  period 
during  the  quarter  the  demand  was  originally  recorded  under 
the  uniform  demand  occurrence  assumption.  The  cumulative 
distribution  function  of  carcass  return  waiting  times  will 
be  partitioned  into  the  following  segments: 


QUARTER 

1 

2 

3 

4 


ELAPSED  DAYS 
0-45 
46  -  135 
136  -  225 
226  -  315 


Figure  8  does  not  break  at  the  above  "Elapsed  Days" 
end  points.  The  assumption  concerning  uniformity  is  again 
invoked  to  average  the  cumulative  distribution  over  the 
periods  in  Table  I  to  obtain  an  estimate  of  the  cumulative 
probability  at  the  points  45,  135,  225  and  315. 


PERIOD 

DAY 

CUM  PROB 

DIFFEREN( 

,1 

45 

.5584 

.5584 

2 

135 

.8537 

.2953 

3 

225 

.9335 

.0798 

4 

315 

.9696 

.0361 
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TABLE  I 

CARCASS  RETURN  DENSITY  AND  CUMULATIVE  DISTRIBUTION  TABLE 


PERIOD 

ELAPSED 

DAYS 

CARCASS 
RETURNS  (X) 

f  (X) 

F(X) 

1 

0 

- 

5 

6,213 

.0563 

.0563 

2 

6 

- 

10 

6,794 

.0616 

.1179 

3 

11 

- 

15 

8,816 

.0799 

.1979 

4 

16 

- 

20 

8,108 

.0735 

.2714 

5 

21 

- 

30 

15,727 

.1426 

.4140 

6 

31 

- 

40 

11,425 

.1036 

.5176 

7 

41 

- 

50 

9,004 

.0816 

.5992 

8 

51 

- 

60 

6,075 

.0551 

.6543 

9 

61 

- 

90 

12,325 

.1118 

.7661 

10 

91 

- 

120 

7,238 

.0656 

.8317 

11 

121 

- 

150 

4,855 

.0440 

.8757 

12 

151 

- 

180 

3,191 

.0289 

.9047 

13 

181 

- 

210 

2,258 

.0205 

.9252 

14 

211 

- 

240 

1,820 

.0165 

.9417 

15 

241 

- 

270 

1,436 

.0130 

.9547 

16 

271 

- 

300 

1,194 

.0108 

.9655 

17 

301 

- 

330 

888 

.0081 

.9736 

18 

331 

- 

365 

933 

.0085 

.9820 

19 

366 

- 

730 

1,573 

.0143 

.9963 

20 

731+ 

410 

.0037 

1.0000 

Given  a  recurring  demand  in  period  one,  the  difference  column 
above  can  be  interpreted  as  being  the  probability  of  receiv¬ 
ing  the  carcass  back  in  that  same  period,  the  following 
period  and  so  on.  This  leads  directly  to  the  time-lag 
model : 

CRF^  =  .5584  RDF^.  +  .2953  +  .0798  ARD^_2  + 

.0361  ARD^_2 

where:  CRF^  =  carcass  return  forecast  for  period  t, 

RDF^  =  recurring  demand  forecast  for  period  t,  and 
ARD^  =  actual  recurring  demand  for  period  t. 

The  model  accounts  for  only  approximately  97  percent 
of  the  carcass  returns.  Because  of  the  four  quarter  baseline 
constraint  of  this  study,  the  model  could  not  include  terms 
beyond  t-4 .  The  inclusion  of  a  forecast  for  recurring 
demand  for  the  current  quarter  follows  the  logic  and  discus¬ 
sion  presented  in  the  regression  model.  The  program  used  to 
synthesize  this  model  was  TREGRESS  Fortran  and  utilized  the 
SPCC  exponential  smoothing  with  filter  procedure  for  fore¬ 
casting  recurring  demands. 

There  are  two  caveats  for  this  model.  ?irst,  the 
model  assumes  100  percent  carcass  returns  per  demands.  The 
model  only  addresses  time  between  the  occurrence  of  the 
demand  and  the  carcass  return  and  not  the  possibility  that 
there  may  be  no  carcass  returned  for  a  particular  demand. 
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The  other  caveat  is  that  the  study  was  conducted  before  the 
introduction  of  NSF  funding  of  repairables.  That  change, 
coupled  with  the  improved  carcass  tracking  program,  could 
alter  lags  between  recurring  demands  and  carcass  returns. 

3.  Demand/Return  (DEMAND) 

Another  model  analyzed  in  this  thesis  was  formulated 
by  SPCC  Code  790  and  sets  carcass  returns  as  a  function  of 
demand.  This  approach  also  incorporates  the  concepts  of 
repair  survival  rate  (RSR)  and  wearout  rate  (WR)  into  the 
forecasting  procedure.  According  to  [Ref.  23]  the  repair 
survival  rate  is  "the  percentage  of  those  carcasses  that 
enter  the  repair  process  that  are  returned  to  RFI  condition." 
The  RSR  is  currently  calculated  at  SPCC  through  an  exponen¬ 
tial  smoothing  process: 


where:  RSR^  =  repair  survival  rate  in  period  t, 

IND  =  inductions  into  the  repair  cycle  in 
period  t, 

SUR^  =  surveys  from  the  repair  cycle  in 
period  t,  and 

a  *  smoothing  constant. 

The  wearout  rate  is  defined  by  [Ref.  24)  to  be: 

...a  measure  of  the  fraction  of  units  that  is  not  expected 
to  survive  repair.  Unlike  the  Repair  Survival  Rate,  the 
Wearout  Rate  considers  not  only  disposals  during  the 
repair  process  but  also  disposals  made  prior  to  the  ship¬ 
ment  of  carcasses  to  the  repair  facility.  In  other  words. 
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disposals  made  at  the  intermediate  level  are  included  in 
the  computation  of  Wearout  Rate.  At  SPCC,  Wearout  Rates 
are  estimated  or  computed  manually  and  entered  into  the 
computer  by  the  technical  personnel. 

The  model  is  motivated  by  the  fact  that  the  UICP 
system  forecasts  recurring  demands  and  carcass  returns 
independently,  and  the  UICP  system  was  designed  under  the 
assumptions  that  all  DLR's  would  be  turned  in  by  customers, 
and  that  all  DLR's  turned  in  by  the  customers  would  be 
inducted  into  the  repair  phase  of  the  repairables  pipeline. 

In  reality  both  situations  contain  flaws.  Carcass 
returns  are  not  independent  of  recurring  demands  but 
actually  a  result  of  demands  as  detailed  in  the  section  on 
the  repairable  pipeline.  Therefore,  the  logical  approach 
is  to  try  to  tie  the  two  forecasts  together.  This  requires 
that  the  differences  in  the  two  forecasts  be  reconciled. 

This  can  be  done  via  the  WR  and  the  RSR.  The  RDF  includes 
advice  code  5A  requisitions  (which  at  SPCC  accounts  for 
8  percent  of  total  recurring  demands)  which  represents  DLR's 
that  are  not  turned  in  by  customers  and  therefore  should  not 
be  reflected  in  the  CRF.  By  including  5A  advice  code 
requisitions  as  a  reduction  to  the  WR,  this  problem  is 
solved.  The  other  key  problem  is  that  not  all  DLR's  turned 
in  by  customers  are  inducted  into  the  repair  phase  before 
they  are  surveyed.  This  results  in  the  RSR  being  artifically 
high.  By  including  surveys  at  the  stock  points  and  collection 
points  in  both,  the  numerator  and  denominator  of  the  RSR 

68 


I 


algorithm,  the  RSR  calculation  is  more  in  keeping  with  its 
definition.  These  two  adjustments  to  RSR  and  WR  in  theory 
provide  for  100  percent  accountability  of  DLR's  and  reconciles 
the  RDF  to  the  CRF. 

The  SPCC-proposed  models,  as  modified  by  discussion 
with  NAVSUP  recorded  in  [Ref.  25] ,  are  ; 


y  (DOPS.  +  CPS.) 
i=l  ^  ^ 


WR^  = 


T  (IND.  +  CPS. ) 
i=l  ^  ^ 


C-J. 

T  (DOPS.  +  CPS.  +  5A.; 
_  i=l _ ^ ^  ^ 


t-1 

Z  ^i 

1^1  ^ 


1  -  WR 


CRF^  *  RDF^  X  CRR^ 


where : 


=  carcass  return  forecast  for  period  t, 

=  recurring  demand  forecast  for  period  t, 
*  carcass  return  rate  for  period  t, 

»  wearout  rate  for  period  t, 

=  repair  survival  rate  for  period  t. 
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DOPS^  =  designated  overhaul  surveys  in  period  i, 

CPS^  =  collection  point  surveys  in  period  i, 

=  actual  advice  code  5A  demands  in  period  i, 

ARD.  =  actual  total  recurring  demands  in  period 
^  i ,  and 

IND.  *  carcasses  inducted  into  repair  phase  in 
period  i. 

SPCC  recommends  that  the  RSR  and  WR  be  kept  as  cumula¬ 
tive  running  sums  from  a  predesignated  starting  point  or 
period,  vice  exponential  smoothed  averages.  Then,  as  time 
goes  by,  the  actual  RSR  and  WR  would  tend  to  approach  steady 
state  positions.  This  assumption  is  good  if  there  is  in  fact 
IQQ  percent  accountability  of  DLR's.  If,  for  instance, 
carcasses  are  lost  in  transit  or  the  carcass  tracking  program 
changes  the  status  of  a  due- in  carcass  to  a  5A  advice  code 
demand,  the  WR  and  RSR  calculations  would  have  to  be  adjusted 
accordingly.  Otherwise  the  two  calculations  might  "lose 
track"  over  time. 

C .  SUMMARY 

The  models  presented  above  represent  a  variety  of  fore¬ 
casting  schemes  from  both  forecasting  theory  and  practice. 

This  thesis  will  examine  how  these  models  perform  with 
actual  U.S.  Navy  supply  system  data.  The  data  itself  will 
be  detailed  in  the  next  section. 
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In  order  to  properly  evaluate  the  forecasting  models  it 
was  necessary  to  obtain  a  realistic  data  set.  Since  the 
model  is  to  be  used  to  forecast  carcass  returns  for  active 
SPCC  repairables,  the  data  were  gathered  based  upon  criteria 
built  around  the  real-world  system  parameters.  The  following 
discussion  will  develop  those  criteria,  detail  the  col¬ 
lection  procedures  and  sources,  and  identify  some  of  the 
problems  associated  with  data  collection,  transfer  and 
interpretation . 

A.  DATA  SELECTION 

The  following  criteria  were  used  to  identify  National 
Item  Identification  Numbers  (NIIN's)  to  be  used  in  testing 
the  forecasting  models: 

1.  Active  items  only  (i.e.  items  that  have  had  one  or 
more  demands  per  quarter) .  The  current  SPCC  model  only 
forecasts  recurring  demands  for  active  items.  Inactive 
items  are  not  included  in  the  recurring  demand  budget 
projections  associated  with  UICP  Stratification  program 
(STRAT) . 

2.  Only  items  with  material  cognizant  (COG's)  symbols  7G 
and  7H.  COG's  7G  and  7H  are  defined  in  [Ref.  26]  as  non¬ 
aviation  depot  level  repairables,  both  managed  by  SPCC. 


SPCC  also  breaks  the  COG's  into  four  digit  categories  to 
further  stratify  demand  patterns.  The  COG's  selected  were 
7Gxy  and  7Hxy  where  X  =  0,  F  or  W  and  y  =  1,  2  or  3. 

3.  Non-family  items.  A  family  is  defined  in  [Ref.  27]: 

...as  a  collection  of  two  or  more  items  under  the 
cognizance  of  an  ICP  that  may  have  a  common  relationship 
to  each  other  due  to  the  existence  of  common  applications 
in  higher  assemblies,  end  items,  or  weapon  systems.  The 
relationships  between  items  in  a  faultily  may  vary  widely; 
some  items  may  be  completely  interchangeable  while  some 
items  may  have  to  be  reworked  before  they  can  be 
substituted  for  another  family  member. 

The  criterion  for  belonging  to  a  family  is  basically 

interchangeadsility .  Because  of  this  the  UICP  programs 

assign  the  sum  of  these  common  applications  to  the  item 

designated  "head  of  the  family"  or  the  most  common  or 

preferred  faunily  member.  The  levels  and  forecasting 

schemes  then  make  their  projections  based  only  on  these 

family  heads.  In  the  selection  of  data  for  the  purpose 

of  testing  the  effectiveness  of  the  various  forecasting 

schemes  all  family  items  were  deleted  from  consideration 

to  eliminate  potential  problems. 

4.  Item  service  entry  date  greater  than  or  equal  to  4  years. 
This  is  to  allow  the  establishment  of  a  normal  pattern  of 
failure  and  usage  data  (i.e.  minimizing  the  "bathtub" 
reliability  effect) . 

5.  Only  items  managed  by  SPCC  Stock  Control  Division  (Code 
340) .  These  items  represent  the  mainstream  items  managed 
by  SPCC  that  do  not  require  extraordinary  management 
attention  such  as  controlled  nuclear  related  parts. 
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It  was  decided  not  to  distinguish  between  items  that 
were  repairable  at  TIR  reporting  activities  and  those 
repaired  at  non-TIR  reporting  activities.  As  discussed  in 
the  section  on  the  TIR  system/  the  UICP  information  on  DLR's 
repaired  at  TIR  reporting  activity  is  more  timely  than  from 
a  non-TIR  activity.  Thus  time  frames  are  more  representa> 
tive  of  actual  carcass  activity  and  movement.  However,  the 
current  UICP  programs  do  not  distinguish  between  reporting 
2md  non-reporting  TIR  activities  when  making  forecasts  and 
other  inventory  calculations. 

B.  DATA  COLLECTION 

The  above  criteria  were  imposed  upon  the  MDF  through  a 
aeries  of  utility  programs.  This  resulted  in  4292  NIIN's 
being  identified  as  candidates  for  testing  the  forecasting 
models.  This  list  of  NIIN's  was  then  used  with  other 
utility  programs  to  extract  the  desired  data  from  both  the 
IHF  and  THF.  The  following  table  lists  the  data  extracted 
for  each  selected  NIIN  and  the  source  (see  Appendix  B  for 
a  more  detailed  listing  of  the  data  collection  parameters) : 


DATA  CATEGORY 

SOURCE 

DESIGNATION 

List  o£  all  NIIN's 

MDF 

MDF 

Actual  carcass  returns 

IHF 

ACR 

Recurring  demands 

IHF 

RD 

Designated  overhaul  point  surveys 

THF 

DOFS 

Collection  point  surveys 

THF 

CPS 
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Inductions  into  repair  phase 


THF 


IND 


Assets  returned  to  "A"  condition  THF  ACON 

Recurring  demands  by  advice  code  THF  5A,  5G,  5S,  5X 

"A"  condition  is  the  condition  code  for  a  serviceeJsle  item 
within  the  supply  system.  Prior  to  "A"  condition,  the  item 
is  considered  to  be  in  "M"  condition  meaming  it  is  being 
repaired. 

The  data  were  collected  during  the  period  December  1981 
April  1982  and  covered  only  the  previous  eight  quarters. 

The  data  were  limited  to  eight  quarters  because  of  data 
breakdown  available  in  the  IHF  and  THF  files.  The  periods 
covered  were: 

QUARTER  PERIOD 


1 

DEC 

79 

- 

FEB 

80 

2 

MAR 

80 

- 

MAY 

80 

3 

JUN 

80 

- 

AUG 

80 

4 

SEP 

80 

- 

NOV 

80 

5 

DEC 

80 

- 

FEB 

81 

6 

MAR 

81 

- 

MAY 

81 

7 

JUN 

81 

- 

AUG 

81 

8 

SEP 

81 

- 

NOV 

81 

The  data  were  collected  on 

tape  files 

with 

one 

tape  per 

transaction  type.  Each  tape  then  listed  all  4292  NIIN's 
with  the  accompanying  eight  observations  representing  the 
summation  of  all  the  transactions  occurring  within  each 
period. 


C.  DATA  MANIPULATIONS 


The  IHF  data  tapes  supplied  by  SPCC  provided  eight 
quarters  of  data  for  each  of  the  4292  NIIN's.  The  THF  dat 
tapes  contained  only  NIIN's  where  there  was  activity  in  at 
least  one  quarter,  and  contained  only  the  quarters  where 
there  were  observation  totals  greater  them  zero. 

The  procedure  was  to  standardize  the  data  files  so  that 
all  4292  NIIN's  were  listed  in  the  sequence  of  oldest 
quarter  first  and  most  recent  quarter  last  so  that  the 
Fortran  prograuns  written  to  run  and  test  the  data  could 
accomodate  any  of  the  files.  To  accomplish  this,  the 
following  steps  were  taken  using  a  series  of  utility 
programs  to  manipulate  the  data  files: 

1.  reorder  the  quarters  of  the  IHF  generated  tapes 
by  a  program  designated  SORT  Fortran, 

2.  create  a  file  of  all  4292  NIIN's  from  the  MOF 
tape  using  program  NIIN  Fortran, 

3.  expand  the  THF  generated  files  to  include  all 
eight  quarters  per  existing  NIIN  by  placing 
zeros  in  the  missing  quarters  and  then  reorder 
the  quarters  as  in  step  1)  through  FORMAT 
Fortran, 

4.  process  the  revised  THF  generated  files  against 
the  file  of  all  4292  NIIN's  using  program  AUG¬ 
MENT  Fortran  resulting  in  a  complete  4292  x  8 
file,  and 

5.  erase  the  original  files  in  mass  storage  and 
place  the  revised,  ready  to  use  IHF  and  THF 
generated  files  into  mass  storage. 


75 


i 


D.  DATA  ADJUSTMENTS 

A  Fortran  program  (SUMCOLS  Fortrzm)  was  written  to  sum 
the  total  dem£uids  or  carcass  returns  for  each  individual 
quarter  and  then  print  the  results  for  a  quarter>by>quarter 
comparison  of  the  totals.  This  was  done  to  highlight  for 
each  item  any  quarter  that  was  grossly  out  of  line  with 
other  quarters  for  either  dem2uids  or  carcass  returns.  The 
check  revealed  the  following  four  situations: 


NIIN 

1 

2 

2 

5 

6 

2 

8 

FILE 

00-938-3665 

3 

4 

60,010 

3 

5 

1 

4 

2 

ACR 

00-937-8496 

2 

13 

15 

44,448 

0 

3 

4 

3 

RD 

00-979-4575 

34 

40 

211 

6,496 

138 

63 

123 

457 

RD 

00-186-8289 

17 

0 

10,015 

10 

11 

18 

21 

8 

RD 

The  four  large  data  points  (all  from  the  IHF  file)  were 
checked  by  SFCC  analysts  and  all  were  determined  to  be  bad 
data.  Four  new  data  points  were  artificially  inserted  into 
the  data  files,  with  each  replacement  value  selected  within 
the  range  of  existing  numbers  for  the  respective  NIIN's. 

E.  DATA  CAVEAT 

The  data  used  in  this  study  covers  the  period  December 
79  -  November  81.  On  1  April  1981,  the  funding  of  DLR's 

i  ^  was  changed  from  APA  funding  to  NSF  funding  as  discussed 

(•  ; 

;  I 

I  I  previously.  This  means  that  before  1  April  1981,  the 

repairaUsle  was  basically  "free"  to  customers.  After  that 
time  the  customer  was  charged  for  the  repairedsle  an  amount 
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based  upon  whether  he  had  a  carcass  to  turn  in  or  not.  This 
funding  cheuige  was  designed  to  encourage  customers  to  return 
repairable  items  into  the  repairables  pipeline  by  penalizing 
them  for  not  returning  a  failed  unit.  The  exact  effect  this 
change  had  on  either  demand  or  carcass  return  data  is  not 
explicitly  addressed  by  this  thesis,  but,  in  fact,  may  have 
exerted  a  significant  impact  on  the  results. 


V.  OUTLIER  ANALYSIS 


Outlier  cmalysis  is  critical  to  any  research  that  uses 
real  data.  Dixon  euid  Massey  [Ref.  28]  state  that  there  are 
two  types  of  "bad"  data  points  that  we  want  to  either 
eliminate  or  be  aware  of  -  outliers  and  incorrect  data 
points.  Outliers  generally  are  extreme  observations, 
either  very  large  or  very  small  2md  can  have  a  substantial 
effect  on  any  standard  regression  analysis  or  standard 
statistics  used  to  judge  the  effectiveness  of  a  forecasting 
method.  Outliers  and  incorrect  data  points  can  result  from 
such  sources  as: 

a)  human  error  (i.e.  a  mistake  either  in  taking  the 
observation  or  in  coding  during  the  man-machine 
interface  phase) , 

b)  data  point (s)  may  be  from  a  population  other  than  the 
one  under  consideration,  and 

c)  the  population  does  harbor  some  abnormally  large  or 
small  values  that  have  surfaced  and  are  legitimate 
(i.e.  the  proposed  model  of  the  underlying  distribution 
may  not  be  correct) . 

Equally  important  is  the  possiblity  that  individual 
observations  of  any  of  the  above  situations  may  be  present 
within  the  range  of  the  bulk  of  the  data  and  not  be  recog¬ 
nized  by  the  statistical  techniques  employed  as  being  "bad" . 

As  discussed  in  the  previous  chapter  the  Fortran  program, 
SUMCOLS,  was  used  to  identify  gross  data  elements  in  the 
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data  set.  The  procedure  identified  the  four  erroneous  NIIN 
values  discussed  in  detail  in  that  section.  SPCC  personnel 
confirmed  that  those  numbers  were  indeed  wrong  and  that  the 
possible  cause  of  their  existence  might  have  been  keypunch 
or  data  entry  error.  With  these  four  numbers  corrected  the 
model  building  and  data  analysis  phase  of  the  thesis  began. 
It  was  soon  apparent  that  there  was  a  tremendous  amount  of 
"noise"  in  the  data. 

A  Fortran  program  named  CHECK  was  written  to  provide  a 
side-by-side  listing  that  matched  recurring  demands  to  the 
actual  carcass  returns  for  a  particular  NIIN  over  the  eight 
quarters  of  data.  This  procedure  revealed  many  NIIN's  with 
data  that  appeared  out  of  line  (i.e.  where  either  the 
carcass  returns  were  an  order  of  magnitude  different,  either 
high  or  low,  from  the  corresponding  demands) . 


Two  exeunples  are  listed  below: 
Centrifugal  P\amp  00-368-3186 
QTR  1  2  3  4  5  6 

ACR  0  0  0  0  0  0 

RD  65  61  92  102  71  129 


7  8 

0  7 

118  99 


Chamber  Assembly  00-678-2686 
QTR  123456  7  8 

ACR  5  24  27  22  116  557  336  301 

RD  556621  1  2 
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SPCC  explained  that  the  pump  was  converted  from  IH  COG  to 
7H  in  April  1981.  Before  that  time  the  pump  was  not 
designated  as  a  repairable  and,  therefore,  not  returned  to 
the  system  for  repair.  SPCC  also  explained  the  anomalous 
behavior  in  the  chamber  assembly  data  by  indicating  that 
the  part  was  being  phased  out  of  the  system  with  no  sub¬ 
stitute  or  replacement  NIIN  listed. 

Based  upon  discussions  with  SPCC  personnel  the  following 
reasons  (not  an  exhaustive  list)  were  put  forward  as  being 
possible  causes  of  incompatible  data  in  the  ACR  and  RD 
files: 

1)  Upon  implementation  of  the  DLR-NSP  test  on  1  April  1981, 
there  was  a  moratorium  on  overdue  or  extra  carcasses . 

The  user  could  turn  in  any  carcass (es)  without  reference 
to  a  specific  demand  or  requisition  ntimber  and  receive 
credit  for  the  carcass  (this  could  lead  to  a  cleaning 
out  of  workbenches) . 

2)  Possible  incorrect  coding  of  requisitions  or  turn-in 
documents  so  that  a  carcass  receipt  is  not  posted 
against  the  correct  requisition  and/or  NIIN. 

3)  Carcass  turn  in  made  by  a  ship  going  into  an  ROH  where 
the  equipment  is  deleted  from  the  COSAL  with  the 
accompanying  spares  being  returned  without  corresponding 
demands . 

4)  Incorrect  coding  of  a  requisition  as  a  non-recurring 
demand  (when  it  should  be  recurring) .  When  the  carcass 
is  siibsequently  returned  it  would  be  identified 
correctly  as  a  carcass  return,  but  there  would  be  no 
corresponding  recurring  demand. 

These  types  of  situations  tend  to  result  in  imbalances 
in  the  ACR  and  RD  totals  illustrated  by  the  above  two 
examples.  In  these  situations  neither  autoregressive  nor 
causal  models  would  be  effective  in  forecasting  carcass 
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retvirns.  In  addition,  causal  models  built  from  noisy  data 
could  also  prove  to  be  a  problem.  Therefore,  it  was  decided 
to  apply  a  filtering  procedure  against  the  ACR  and  RD 
figures  for  each  NIIN  and  to  find  a  subset  of  NIIN's  whose 
carcass  return  and  recurring  demand  patterns  and  totals  were 
related  realistically.  In  developing  the  filter,  it  was 
assiimed  that  carcass  returns  and  recurring  demands  are 
positively  related  in  some  manner,  and  that  there  are  many 
forces  and  actions  within  the  supply  system  that  cause 
outliers  or  erroneous  data  points  to  enter  the  data  files 
that  are  not  indicative  of  the  underlying  relationship  of 
carcass  returns  to  recurring  demands. 

The  purpose  of  the  filter  is  to  eliminate  the  data 
points  extraneous  to  the  model  building  process.  All  the 
models  will  then  be  synthesized  using  both  the  filtered 
and  unfiltered  data. 

The  Fortran  program  OUTLIER  was  written  to  implement 
the  criteria  outlined  in  Table  2.  The  criteria  are  based 
on  two  sums  for  each  individual  NIIN:  the  sum  of  actual 
carcass  returns  and  the  sum  of  recurring  demands  both  taken 
over  the  eight  quarters.  The  third  figure  computed  is  R, 
the  ratio  of  total  carcass  returns  to  total  recurring 
demands.  In  theory,  the  ratio  of  carcass  returns  to 
recurring  demands  over  the  life  of  a  particular  item  (i.e. 
the  steady  state  rate)  should  be  approximately  1.0.  In 
reality  many  carcasses  never  make  it  back  to  the  repair 
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cycle  (i.e.  5A  advice  code  requisitions  and  collection  point 
surveys)  and  in  any  short-rxin  period  carcass  returns  can  lag 
behind  their  corresponding  dememds.  These  factors  would 
make  the  ratio  R  somewhat  less  than  1.0.  The  lower  bound 
for  R  was  arbitrarily  set  at  0.5.  The  upper  bound  of  R  was 
set  at  1.5  for  total  recurring  demands  less  than  or  equal 
to  50 .  This  is  to  allow  for  carcasses  returning  for  demands 
recorded  in  a  period  prior  to  the  eight  quarters  used  in  the 
project.  For  total  demands  of  greater  than  50,  R  was  set  at 
1.25.  The  cut-off  point  of  50  was  also  arbitrary,  but 
selected  to  allow  for  two  ranges  for  R  since  the  quotient 
of  a  division  operation  will  vary  greater  with  a  change  in 
the  numerator  when  the  denominator  is  small. 

The  program  OUTLIER  identified  2974  NIIN's  as  acceptable; 
that  is,  within  the  bounds  as  established  by  Table  2.  This 
represents  69  percent  of  the  original  4292  NIIN's  and  points 
:at  that  a  significant  portion  of  the  data  may  cause  real 
problems  in  the  implementation  of  any  forecasting  model.  It 
also  points  out  that  some  type  of  screening  or  filtering 
technique  should  be  used  to  screen  the  data  as  is  the  case 
with  the  currently  implemented  UICP  exponential  smoothing 
model. 

One  final  caveat  to  filtering  data  is  provided  by 
Makridakis  and  Wheelwright  [Ref.  29] .  They  state  that 
judgment  must  be  used  as  to  when  adjustments  to  data  really 
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will  improve  the  accuracy  of  the  forecast  and  when  they  will 
not.  The  key  problem  is  that  filtering  also  tends  to 
eliminate  some  of  the  valid  information  contained  in  the 
data.  While  adjusting  a  data  set  facilitates  the  use  of 
standard  forecasting  schemes,  the  results  may  not  be  as 
reliable  with  the  loss  of  the  outlying  but  relevant  data. 


VI.  MODEL  BUILDING 

This  chapter  deals  with  the  formulation  of  regression 
models  only.  The  first  section  discusses  carcass  returns 
regressed  on  total  recurring  demands  and  the  second  section 
details  regression  models  with  carcass  returns  as  a  function 
of  recurring  demands  by  advice  codes.  All  regressions  were 
linear  and  conducted  on  the  Statistical  Analysis  System 
(SAS)  . 

In  both  cases  the  procedure  was  to  obtain  the  parameters 
for  the  linear  equation  by  running  the  regression  on  as  much 
data  as  possible.  This  included  data  for  all  eight  quarters. 
Therefore,  the  pareuneters  were  partially  obtained  by  using 
data  that  was  subsequently  used  to  test  those  parameters 
against  the  MOE's.  This  overlap  only  involved  the  data  for 
the  last  four  quarters.  As  a  result,  this  procedure  will 
bias  the  MOE  statistics.  No  attempt  was  made  to  identify 
or  measure  the  bias.  It  was  felt  that  obtaining  regression 
models  using  only  data  from  the  first  four  quarters  (i.e. 
eliminating  half  of  an  already  time  constrained  data  set) 
would  have  caused  more  serious  problems  than  the  bias  intro¬ 
duced  into  the  MOE's  by  including  all  the  data. 

As  discussed  in  the  section  on  regression  models,  the 
model  used  for  regressions  was: 
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Y  *  X  S  +  u  , 

where:  Y  *  dependent  variable, 

X  =  independent  variable, 

B  «  parameters  to  be  determined,  and 
u  =  error  term. 

The  following  excunple  will  illustrate  the  procedure  used 
to  build  the  input  matrix  for  SAS  for  all  the  regression 
models.  Consider  the  model: 

CRF^  =  ^^t-1  ^2  ^^t-2* 

Here  the  carcass  return  forecast  (or  average)  is  a  function 
of  the  two  previous  quarters  actual  recurring  demands  (ARD) 
with  no  intercept  term.  Since  there  are  eight  quarters  of 
available  data,  the  third  quarter  carcass  return  forecast 
would  be  a  function  of  actual  demands  in  quarters  one  and 
two,  the  fourth  quarter  forecast  would  be  a  function  of 
demands  in  quarters  two  and  three  and  so  on.  This  would 
correspond  to  a  SAS  input  matrix  configuration  as  follows; 


where:  ACR^^  -  actual  carcass  returns  in  period  i,  and 
ARDj^  =  actual  recurring  demands  in  period  i. 

In  this  case  Y,  the  dependent  variable,  would  be  a  (6x1) 
matrix  and  X,  the  independent  variable,  would  be  a  (6x2) 
matrix.  Since  the  regression  is  to  be  run  on  all  4292  NIIN's, 
y  becomes  a  ((4292  x  6)  x  1)  or  (25,752  x  1)  matrix  and  X 
becomes  a  ((4292  x  6)  x  2)  or  (25,752  x  2)  matrix.  When  the 
regressions  for  this  particular  model  are  run  for  the  2974 
filtered  NIIN's,  the  Y  and  X  matrices  would  be  (17,844  x  1) 
and  (17,844  x  2)  respectively.  If  the  CRF  is  to  be  a  function 
of  the  three  previous  quarters  then  the  dimensions  of  the 
individual  NIIN's  Y  and  X  matrices  are  reduced  by  one  obser¬ 
vation  ^each  to  become  (5x1)  and  (5  x  3)  respectively.  The 
full  X  and  Y  matrices  for  both  4292  and  2974  items  are 
correspondingly  smaller. 

A.  RECURRING  DEMAND  REGRESSIONS 

Table  III  lists  the  regressions  riin  on  recurring  demands 
using  all  4292  NIIN's.  Table  IV  presents  the  regression 
results  using  the  filtered  NIIN's  only.  Each  model  is 
individually  identified  by  an  alphabetic  character  (the 
ordering  of  the  models  does  not  have  any  significance) .  A 
single  character  designation  (e.g.  A)  means  that  the  model 
was  a  result  of  a  regression  on  all  4292  items.  A  double 
character  designation  (e.g.  AA)  indicates  that  the  model  was 


REGRESSION  ON  RD  (RAW) 


REGRESSIONS  ON  RD  (FILTERED) 


the  result  of  a  regression  based  upon  the  2974  filtered 
items.  The  cumulative  total  column  is  the  algebraic  summa¬ 
tion  of  the  parameters  for  each  model.  This  total  shows 
the  percentage  of  recurring  demands  that  are  represented 
by  carcass  returns  for  each  model.  For  example.  Model  A 
suggests  that  65  percent  of  all  recurring  demands  result  in 
a  carcass  return.  The  column  "intercept"  is  the  or  inter¬ 
cept  term  in  the  regression  line,  "RD"  means  recurring  demands 
in  the  current  quarter,  "RDMl"  literally  translates  to  recur¬ 
ring  demands  minus  one  (or  a  lag  of  one  quarter) .  RDM2  means 
a  lag  of  two  quarters  and  so  on.  A  blank  entry  in  the  column 
of  any  one  model  means  that  the  coefficient  of  the  respective 
column  heading  is  zero.  While  all  the  standard  regression 

statistics  were  calculated  by  SAS,  only  the  individual  model 

2 

parameters,  the  R  statistic  and  standard  deviation  of  each 
model  are  displayed.  In  all  cases  the  F  statistic  was 
significant  and  the  Durbin-Watson  statistic  showed  no 
autocorrelation . 

All  models  were  rvin  with  and  without  intercepts.  In 
theory  the  intercept  should  be  an  adjustment  factor  to  the 
explanatoxry  variables  not  present  in  the  model.  In  all  cases 
the  intercept  term  made  a  relatively  insignificant  contribu¬ 
tion  to  the  forecast. 

Table  V  is  a  display  of  the  models  chosen  for  synthesis 
using  the  SPCC  data.  Models  B  auid  BB  were  selected  because 
the  CRF  in  period  t  is  represented  as  a  direct  function  of 


TABLE  V 

REGRESSION  MODELS 


Desig¬ 
nation  Model 


Regression 
Based  upon 


B 

CRF^ 

S 

.6564 

RDFt 

Raw  Data 

D 

CRF^ 

- 

.3663 

RDF^  +  .3833  AD^.^ 

Raw  Data 

F 

CRF^ 

s 

.6809 

AD 

^t-1 

Raw  Data 

K 

CRF^ 

s 

.5283 

+  .1369  RDP^  +  .1953  AD^.^  + 

Raw  Data 

.1737 

AD^_2  +  .2522  AD^_3 

L 

CRF^ 

» 

.1376 

RDF^  +  .1960  AD^_i  + 

Raw  Data 

.1744 

ADt.2  +  -2530  AD^.3 

N 

CRF^ 

s 

.4032 

AD^_j^  +  .3363  AD^_2 

Raw  Data 

BB 

CRF^ 

S8 

.8383 

RDFt 

Filtered 

Data 

DD 

CRF^ 

S 

.3219 

RDF^  +  .5739  AD^_]^ 

Filtered 

Data 

FP 

CRF^ 

ss 

.8772 

ADt_i 

Filtered 

Data 

GG 

CRF^ 

* 

-.5167  +  .1281  RDF^  +  .4233  AD^_i  + 

Filtered 

Data 

.3586 

^t-2 

HH 

CRF^ 

a 

.1270 

RDF^  +  .4225  AD^.^ 

Filtered 

Data 

.3578 

ADt-2 

PP 

CRF^ 

9 

.4916 

AD^..j^  +  .4144  AD^_2 

Filtered 

Data 
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the  recurring  demands  also  in  period  t.  In  practice  the 

recurring  demands  for  the  current  period  are  not  available 

until  the  end  of  the  period,  so  the  CRF  becomes  a  function 

of  the  recurring  demand  forecast  as  discussed  previously. 

Models  F  and  FF  test  the  hypothesis  that  the  CRF  is  simply 

a  function  of  the  actual  recurring  demands  in  the  previous 

period.  This  model  predicts  the  carcass  returns  on  the  most 

current,  actual  observation  vice  a  forecast  as  in  B  and  BB. 

This  model  is  similar  to  the  naive  forecasting  model,  but  it 

uses  a  coefficient  other  than  one.  Models  D  and  DD  combine 

the  above  models  to  make  the  CRF  a  function  of  both  the 

current  quarter's  recurring  demand  forecast  and  the  previous 

quarter's  actual  observations.  Models  L  and  HH  were  selected 

2 

for  testing  because  they  have  the  highest  R  statistics  with¬ 
in  their  respective  data  groups.  Similarily,  models  K  and  GG 
were  selected  for  the  lowest  standard  deviation  calculations. 
It  should  be  noted  that  models  MM  and  NN  both  had  more  favor- 
cible  statistics  than  models  GG  and  HH,  but  MM  and  NN  were 
disregarded  because  in  both  cases  the  coefficient  of  the 
current  quarter's  recurring  demand  was  a  negative  number. 
Intuitively,  the  recurring  demands  in  a  quarter  could  not 
serve  to  reduce  the  carcass  returns  expected  to  arrive  in 
that  period.  Models  N  and  PP  were  selected  because  of  their 
intuitive  appeal.  It  is  realistic  to  expect  that  carcasses 
arriving  in  period  t  were  generated  by  demands  in  period  t-1 
and  t-2.  It  also  is  a  model  that  is  predicated  upon  pa^t 


actual  data  and  does  not  use  any  forecasted  values.  The  t 
statistics  of  the  parameters  for  all  the  models  listed  in 
Table  V  were  all  greater  than  | 2 | ,  thus  significant  at 
significance  levels  of  .05  and  greater. 

It  is  interesting  to  note  that  the  regression  statistics 
in  Tables  III  and  IV  are  more  a  function  of  the  data  used  to 
construct  the  model  than  the  model  itself.  There  was  some 
varicuice  among  the  statistics  within  each  data  set  category, 

but  not  as  significant  as  between  the  data  sets  themselves. 

2 

When  all  the  data  were  used  the  R  or  coefficient  of  deter¬ 
mination  tended  to  be  approximately  .5.  This  indicates 
that  a  significant  portion  of  the  total  variance  is  not 
explained  by  the  regression  (i.e.  the  carriers  selected). 
Thus  the  model  does  not  fit  the  available  data  very  well. 
This  could  cause  the  forecasts  resulting  from  one  of  these 
models  in  any  particular  period  to  vary  considerably  as 
seems  to  be  indicated  by  the  large  standard  deviation 
statistics.  The  statistics  on  the  filtered  data,  as  would 
be  expected,  show  significant  improvement.  The  standard 
deviation,  however,  is  still  relatively  high.  This  could 
indicate  that  there  are  problems  with  the  model  or  that 
carcass  returns  vary  widely  and  are  inherently  difficult  to 
predict . 
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B.  ADVICE  CODE  REGRESSIONS 

Due  to  the  large  number  of  possible  carriers  with  respect 
to  the  advice  codes  and  the  SAS  data  capacity  limitations,  a 
subset  of  the  4292  item  data  set  was  used  in  the  regression 
phase  of  the  advice  code  model  building.  A  ten  percent 
random  S2unple  of  the  4292  NIIN's  was  determined  by  a  program 
RANDOM  Fortran  which  called  upon  a  computer  library  sub¬ 
routine  that  contained  a  pseudo  random  number  generator. 

This  procedure  is  detailed  in  Appendix  C. 

Table  VI  contains  the  results  of  the  regressions  of 
carcass  returns  on  advice  codes.  Table  VI  is  constructed 
in  a  similar  fashion  to  Tables  III  and  IV  with  the  three 
categories  of  advice  codes  across  the  top  of  the  display. 

The  star  behind  a  particular  number  indicates  that  that 
coefficient  failed  the  t  test  (i.e.  the  t  statistic  was  less 
than  I  2  I ) .  The  cumulative  distribution  column  has  been 
deleted.  In  the  case  of  the  regression  using  recurring 
demands  only,  the  cumulative  total  effect  could  be  employed 
because  there  was  only  one  general  category  of  explanatory 
variables.  In  the  advice  code  model  there  are  three  distinct 
categories . 

Regression  9  was  used  to  represent  the  advice  code 
regression  model  even  though  models  1,  2  and  4  had  slightly 
better  overall  statistics  and  more  significant  parameter 
values  as  determined  by  the  t  statistics.  Model  9  was 
selected  over  those  three  because  all  of  them  required  a 
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ADVICE  CODE  REGRESSIONS 


An-&124  606  AN  ANALYSIS  OF  MOpELS  FOR  FORECASTING  REPAIRABLE  A /  ^ 

CARCASS  RETURNS(U)  NAVAL  POSTGRADUATE  SCHOOL  MONTEREY  ^ 

CA  D  M  HARTMAN  OCT  82 


i 

■f 

3 


MICROCOPY  RESOLUTION  TEST  CHART 

NMtONAL  BUREAU  OF  STANOAROS-1963-A 


prediction  of  advice  code  demands  in  the  period  to  be 
forecast.  While  there  is  a  recurring  demand  forecasting 
procedure,  there  is  no  provision  in  the  UICP  system  for 
fOi^ecasting  the  number  of  recurring  demands  for  a  period  by 
advice  code  category.  The  model  selected  requires  only 
advice  code  information  that  is  avail2d>le  from  the  previous 
quarters . 
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VII.  EVALUATION  CRITERIA 


There  are  a  number  of  measures  of  effectiveness  (I«3E's) 
or  evaluation  criteria  to  test  any  forecasting  scheme.  Each 
MOE  is  unique  and  will  generally  identify  a  specific  fore¬ 
casting  technique  as  superior  to  the  others.  However,  this 
does  not  assure  that  all  MOE's  will  identify  the  same  method 
as  being  optimal.  Therefore,  five  popular  MOE's  have  been 
selected  to  test  the  various  carcass  return  forecasting 
methods  examined  in  this  thesis.  The  evaluation  and  comment 
sections  will  discuss  the  merits  of  each  forecasting  method 
with  respect  to  each  of  the  MOE's  listed  below. 

A.  MEAN  ABSOLUTE  ERROR  (MAE) 

n 

^  1  ACR.  -  CRP.  I 

MAE  =  — -  ' 

n 

where:  ACR^  »  actual  carcass  returns  for  item  i, 

CRFj^  =  carcass  return  forecast  for  item  i,  and 
n  a  total  number  of  items  being  evaluated. 

The  reuige  of  MAE  is  zero  to  plus  infinity. 

B.  MEAN  ERROR  (ME) 

The  mean  error  criterion  is  divided  into  two  ranges  - 

positive  errors  and  negative  errors.  This  measure  shows  the 

bias  of  a  particular  method  towards  either  high  (positive) 

or  low  (negative)  forecasts  and  the  magnitude  of  the  biases. 
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1.  Mean  Positive  Error  (MPE) 


np 


MPE 


^  (ACR^  -  CRF^) 


np 


for  all  ACR^  >  CRF^, 

where:  np  »  total  number  of  observations  where 
ACRj^  ^  CRF^. 

2.  Mean  Negative  Error  (MNE) 


nn 


MNE 


T  (CRF.  -  ACR.) 
i»l  ^  ^ 


nn 


for  all  ACR^  <  CRFj^, 

where:  nn  =  total  number  of  observations  where 
ACR.  <  CRT. 

X  **  X  • 

The  range  of  both  MPE  and  IQIE  is  positive  and  each  will  be 
shown  separately. 


C.  MEAN  FORECAST  ERROR  (MFE) 


MPE  ■ 


(CRP^  -  ACR^) 
n 


This  MOE  differs  from  mean  absolute  error  in  that  all  fore~ 
casting  errors  are  simply  summed  with  their  appropriate  signs 
vice  using  the  2d380lute  values.  This  results  in  averaging 
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the  positive  and  negative  errors.  Thu&  the  range  of  this 
MOE  is  from  minus  infinity  to  plus  infinity.  The  optimal 
forecasting  method  would  presumably  be  the  method  with  MFE 
closest  to  zero.  The  bias  of  the  method  is  indicated  by  the 
sign  of  MFE.  If  MFE  is  positive#  the  forecasting  method 
tends  to  overestimate  carcass  retxims  emd#  conversely#  if 
the  MFE  is  negative  it  underestimates  carcass  returns. 

D.  ROOT  MEAN  SQUARE  FORECAST  ERROR  (RMSFE) 


where:  MSE  »  mean  squared  error. 

MSE  is  discussed  in  detail  by  MaJcridakis  amd  Wheelwright 
[Ref.  30] .  MSE  and  RMSFE  are  often  used  because  of  their 
similarity  to  the  familiar  variance  and  standard  deviation 
calculations.  They  differ  only  in  that  varieuice  is  calculated 
using  the  mean  of  the  observations  vice  the  forecasted  value 
(CRF^) . 
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E.  MEAN  ABSOLUTE  PESCEMTAGE  ERROR  (MAPE) 

n 

Z  1  PEi  1 

MAPE  »  " 

n 

ACR.  -  CRF. 

-  I - I  =<  “0  • 

where:  PE^  »  percentage  error  for  item  i. 

This  MOE  is  also  detailed  in  [Ref.  30] .  The  rcuige  of  the 
NAPE  is  zero  to  plus  infinity.  The  same  weighting  is  applied 
to  both  high  amd  low  estimates  by  a  forecasting  method. 
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VIII.  MODEL  ANALYSIS 


The  results  of  the  forecasting  models  synthesized  with 
the  spec  data  will  be  displayed  amd  analyzed  in  this 
section.  As  a  result  of  the  outlier  screening  procedure, 
the  models  were  run  a)  with  all  the  SPCC  data  (identified 
as  "raw"  data)  and  b)  only  with  the  data  that  survived  the 
filtering  process  (identified  as  "filtered"  data) .  The 
results  for  each  forecasting  method  are  listed  by  HOE  and 
quarter  for  the  period  December  1980  -  November  1981  in 
Appendix  D.  The  quarters  correspond  to  the  following 
periods : 


QTR  PERIOD 

5  DEC  80  -  FEB  81 

6  MAR  81  -  MAY  81 

7  JUN  81  -  AUG  81 

8  SEP  81  >  NOV  81 

The  MOE  is  listed  at  the  top  of  the  page.  The  model  and  the 
data  used  to  test  the  model  are  listed  on  the  left-hand  side 
of  the  page.  The  MOE's  correspond  to  those  described  in  the 
evaluation  criteria  chapter.  The  right  most  column  is  the 
average  of  the  MOE's  across  the  row. 

The  MOE  averages  are  carried  forward  for  evaluation 
purposes  and  are  displayed  in  Tables  7  -  11  in  this  chapter. 
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For  each  taddle  the  HOE  is  listed  across  the  top  margin  with 
the  model  designation  along  the  left-hand  margin.  As  in  the 
appendices,  the  models  are  separated  by  the  data  type, 
either  raw  or  filtered.  The  niimber  in  each  cell  represents 
the  average  value  for  the  designated  model  for  that  HOE  over 
the  four  quarters  measured  in  Appendix  D.  The  asterisk 
indicates  the  best  value  in  each  column  for  a  particular 
MOE.  The  MOE's  are: 

MAE  -  mean  absolute  error 

MFE  -  mean  forecast  error 

RMSFE  -  root  mean  square  forecast  error 

MAPE  -  mean  absolute  percentage  error 

MPE  -  mean  positive  error 

MNE  -  mean  negative  error 

"No."  Indicates  the  number  of  observations  that  made  up 
either  MPE  or  MNE,  whichever  it  follows. 

A.  REGRESSION  MODELS  (REG) 

TeUble  7  siimmarizes  the  results  for  the  regression  models. 
The  letter  designated  a  particular  regression  model  is 
keyed  to  the  model  as  defined  in  the  model  building  chapter. 

For  the  models  run  against  all  the  data.  Model  B  was 
superior  to  all  the  others  except  in  the  category  MPE  where 
model  FF  was  better.  Models  B  emd  FF  are  similar  in  that 
the  CRF  is  simply  the  function  of  one  explanatory  variable 


REGRESSION  MODEL  RESULTS 


TABLE  VII  (C(»tTINUED) 


1 


in  ttach  case.  For  modal  B,  the  forecast  is  a  function  of 
just  the  recurring  demand  forecast  trhich  is  exponentially 
determined.  Model  therefore,  is  the  model  that  best  fits 
using  all  the  data. 

When  the  regression  models  were  run  with  the  filtered 
data  there  was  no  clear  cut  "best"  model.  Model  BB  did, 
however,  show  well  in  the  two  categories  of  MAE  emd  MFE. 
Model  BB  also  had  a  BMSFE  that  was  close  to  the  lowest 
values  obtained.  Model  BB  appears  to  provide  the  best  fit 
when  only  filtered  data  are  used. 

The  results  are  interesting  in  that  model  B  was  obtained 
through  regressions  on  raw  data  and  then  tested  the  best 
using  the  MOE's.  Model  BB  is  the  same  model  as  B,  except 
that  it  was  obtained  through  regressions  on  filtered  data  on 
which  it  sxibsequently  tested  as  the  best  model.  Both  models 
identified  carcass  return  forecasts  as  a  function  of  the 
recurring  demand  forecasts.  Model  BB  (determined  by  the 
fi?,tered  data)  did  a  relatively  good  job  of  forecasting 
vdien  all  the  data  was  tested,  but  conversely  model  B  did  not 
show  particularly  well  against  the  filtered  data  except  with 
respect  to  the  MAPE  measure.  It  is  important  to  note  that 
all  models  did  significantly  better  jobs  of  forecasting  when 
the  data  was  first  filtered  before  being  applied  to  the 
models . 
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B.  EXPONENTIAL  SMOOTHING  (ES) 

The  results  of  the  pure  exponential  smoothing  model  are 
displayed  in  Tables  8  euid  9  for  raw  and  filtered  data 
respectively.  Unlike  the  UICP  exponential  smoothing  model, 
these  models  did  not  have  a  filtering  or  screening  system. 

For  the  models  synthesized  with  all  the  SPCC  data.  Table 
8  shows  that,  except  for  MFE,  [.35,  .501  is  the  optimal 
range  for  a.  This  is  greater  weight  than  those  used  by  the 
UICP  models  [0.1,  0.3].  Again,  it  is  importemt  to  note  that 
no  filtering  is  used  in  this  model  as  in  the  actual  UICP 
models.  The  MFE  calculation  is  highest  at  ot  =  .05  and  is 
monotonically  decreasing  to  its  low  value  at  the  boundary 
value  of  a  a  1.0  (or  the  naive  forecasting  model).  The 
model  that  will  be  compared  with  other  models  will  be 
a  =  .4  because  it  is  in  the  above  optimal  range. 

Table  9  displays  the  results  when  the  exponential 
smoothing  models  are  applied  to  data  that  has  already  been 
filtered.  Here,  the  model  with  a  -  .2  appears  to  be  the 
best,  even  though  there  is  little  difference  between  it  and 
the  model  with  a  »  .25.  Of  interest  is  that  MFE  is  not 
monotonically  increasing  as  with  the  raw  data,  but  the  RMSFE 
is. 

For  the  exponential  smoothing  models  there  is  a  differ¬ 
ence  between  the  MOE's  as  a  result  of  using  different 
input  data,  but  not  as  significant  as  with  the  regression 


106 


EXPONENTIAL  SMOOTHING  MODEL  RESULTS 
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TABLE  VIII  (CONTINUED) 


EXPONENTIAL  SMOOTHING  MODEL  RESULTS 
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models.  This  probably  results  from  the  exponential 
smoothing  models  being  more  "flexible”  or  robust  with  respect 
to  data  with  large  variances  as  compared  to  the  fixed 
parameter  regression  models.  The  model  with  a  »  1.0  which 
predicts  carcass  returns  as  merely  what  they  actually  were 
in  the  last  period  did  a  better  forecasting  job  than  the 
respective  regression  models  F  and  FF  where  carcass  returns 
were  a  fixed  percentage  of  recurring  demands  from  the 
previous  quarter. 

C.  MOVING  LEAST  SQUARES  (MLS) 

The  moving  least  squares  model  results  are  listed  in 
Table  10.  The  left-hand  column  indicates  "MLS"  for  moving 
least  squares  and  the  number  of  quarters  used  in  each  model 
for  determining  the  forecast,  in  the  case  of  both  input 
data,  the  model  predicated  on  the  previous  four  quarters 
did  the  best.  As  explained  previously,  the  model  was 
limited  to  reaching  back  four  quarters  to  obtain  a  base  for 
ni2Ucing  the  forecast,  and  therefore,  it  cannot  be  determined 
if  five  or  more  quarters  would  have  made  better  models .  The 
four  quarter  model  does  tend  to  smooth  out  outliers  more 
than  the  two  quartesrs  models.  While  the  models  using  fil¬ 
tered  data  did  show  slightly  improved  MOE  statistics,  the 
MAPS  for  both  data  sets  was  virtually  identical  indicating 
that  the  model  is  very  robust  and  equally  good  (or  bad) 
with  raw  or  filtered  data. 


(CONTINUED) 


0.  MOVING  AVERAGE  (MA) 

The  moving  average  model  results  are  also  listed  in  Table 
10  just  below  the  moving  least  square  results  and  identified 
as  "MA"  models.  While  the  two  quarter  models  showed  some 
promise,  the  four  quarter  models  again  were  overall  better. 
The  four  quarter  models  tend  to  smooth  outliers  into  the 
forecast  more  effectively  than  shorter  quarter  input  models. 
Again,  as  in  the  MLS  model,  the  results  did  not  vary 
drastically  for  the  raw  and  filtered  data  indicating  that 
the  moving  average  model  is  also  fairly  robust. 

E.  ALL  MODELS 

Table  11  lists  all  the  models  developed  cuid  discussed 
in  the  models  section.  It  only  includes  one  candidate 
variation  of  each  of  the  models  discussed  previously  in 
this  chapter.  The  models  are: 

SPCC  UICP  exponential  smoothing  model  in  use  at  SPCC, 
ARR  -  adaptive  response  rate  model, 

DEMAND  -  SPCC  proposed  demand/return  model, 

LAG  -  time>lag  carcass  return  model, 

REG-ADV  -  advice  code  regression  model, 

REG-B  '  recurring  demand  regression  model  B, 

REG-BB  -  recurring  demand  regression  model  BB, 

MLS-4  QTR  -  moving  least  square  4  quarter  model. 
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COMPARISON  OF  RESULTS  OF  ALL  MODELS 


MA-4  QTR  -  moving  average  four  queurter  model, 

ES-as.4  -  exponential  smoothing  model  with  a  »  .4,  and 
ES-*aa>.2  -  exponential  smoothing  model  with  a  -  .2. 

Using  both  types  of  data,  the  DEMAND  model  had  the  worst  showing 
overall.  Measured  against  the  raw  data,  three  techniques 
were  approximately  equal  in  their  demonstrated  forecasting 
abilities  -  the  SPCC  model,  ARR  emd  ES-o=*.4.  The  SPCC 
model  was  the  only  one  of  the  three  to  employ  a  filter. 

The  three  models  are  similar  in  that  they  all  basically 
employ  the  exponential  smoothing  technique  to  produce  the 
forecast.  The  moving  average  emd  the  moving  least  squares 
models  were  next  in  forecasting  cd>ilities,  with  the  moving 
average  model  clearly  superior  to  the  moving  least  squares 
model.  This  could  be  explained  by  the  fact  that  the  MA 
model  is  simply  the  average  of  the  previous  four  observa** 
tions,  thus  smoothing  out  extremeous  data  points  while  the 
MLS  is  a  projection  of  a  "best  fit"  line  through  the  data 
points.  The  implication  is  that  the  carcass  returns  follow 
an  average  value  pattern  more  than  a  demonstrated  trend. 

The  remaining  models  are  all  causal  or  regression  type 
schemes  with  fixed  parameters.  As  a  group,  they  did  not 
forecast  with  the  same  accuracy  as  the  other  models.  The 
advice  code  regression  model  displayed  the  most  potential 
as  an  estimator  of  cucass  returns. 
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The  current  SPCC  forecasting  model  makes  the  overall 
best  forecasts  when  synthesized  with  the  filtered  data. 

Even  though  the  RMSFE  for  the  MA-4  QTR  model  is  lower, 
the  SPCC  model  does  almost  as  well.  The  ARR  model  did  as 
well  as  with  the  raw  data,  but  the  exponential  smoothing 
model  ES-'as.2  (no  filters  in  the  model  as  in  the  SPCC  model) 
did  almost  as  well  or  better  than  the  SPCC  model  for  all 
MOE  categories.  This  is  prob£d3ly  explained  by  the  fact  that 
the  SPCC  model  a  value,  which  is  either  .1  or  .3  depending 
on  the  trending  present,  brackets  the  ES  model  with  as. 2. 

The  high  filter  in  the  SPCC  model  is  prob2d>ly  not  necessary 
because  of  the  filtering  previously  performed  on  the  data. 
This  would  bring  almost  all  of  the  observations  to  within 
six  standard  deviations  of  the  average  carcass  return  rate, 
thus  virtually  eliminating  the  high  filter  gross  adjustments. 
Again  the  moving  average  model  shows  better  MOE  performance 
than  the  moving  least  squares  model.  The  filtered  causal 
models  all  show  significant  improvement  in  their  forecasting 
abilities  over  their  unfiltered  counterparts  except  for  the 
SPCC  proposed  DEMAND  model  which  shows  only  slight  improve¬ 
ment  despite  the  filtering  process.  The  model  REG-BB  which 
was  determined  through  regressions  on  the  filtered  data  does 
the  best  of  the  causal  models.  However,  as  discussed  earlier 
there  is  probably  s<xne  bias  involved  in  using  the  same  set 
of  data  to  both  derive  the  model  and  then  test  it.  The 
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significance  of  the  regression  model  is  that  it  may  help  to 
identify  the  carcass  return  pattern  of  a  "normal”  recurring 
demand  situation.  This  results  from  eliminating  the 
outliers  before  modeling. 

The  models  as  a  whole  were  able  to  forecast  significantly 
better  as  measured  by  the  MOE's  when  a  filtering  process  was 
applied  to  the  data  before  synthesizing  with  the  models. 
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IX.  CONCLUSION 


The  following  discussion  will  contain  qualifications  to 
the  study,  conclusions  of  the  study  and  areas  for  further 
consideration . 


A.  QUALIFICATIONS 

There  are  several  qualifications  to  this  forecasting 
study. 

1)  The  data  used  to  build  the  forecasting  models  and  to 
test  the  models  was  not  a  random  sampling  from  all  SPCC 
managed  repairable  items.  The  data  selection  process 
was  constructed  with  the  intent  of  identifying  items 
that  had  an  established  observable  pattern  of  recurring 
demand.  Also  the  data  were  restricted  to  those 
recurring  demands  and  carcass  returns  specifically 
identified  to  a  particular  item  (e.g.  no  family  items) . 

2)  The  short  time  frame  for  which  data  were  available  by 
quarters  from  the  IHF  precluded  the  use  of  may  time- 
series  dependent  models.  This  situation  may  also  have 
contributed  to  the  poor  performance  of  the  SPCC 
proposed  DEMAND  model  because  there  may  not  have  been 
a  long  enough  start  up  or  baseline  period  to  establish 
long  term  (or  steady  state)  repair  survival  rates  and 
wearout  rates. 

3)  The  lack  of  cumulative  data  totals  and  forecasts  for 
all  data  items  at  the  beginning  of  the  study  required 
that  half  of  the  data  available  for  each  item  be  used 
to  either  build  the  model  to  be  tested  or  used  as  start 
up  data  for  the  forecasting  techniques  to  be  employed 
over  the  final  four  quarters  actual  data.  The  start 
up  period  necessarily  limited  the  scope  of  the  parcua- 
eters  of  some  of  the  forecasting  models  -  specifically 
moving  average  and  moving  least  squares. 

4)  The  timing  of  the  forecasting  study  may  have  been  bad 
because  of  the  initiation  of  the  Navy  Stock  Fund  - 
Depot  Level  Repairables  Test  funding  change  that 
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occurred  1  April  1981.  Thus  five  quarters  of  the  data 
used  in  the  study  was  pre-NSF  funding  of  repairables 
and  the  other  three  quarters  data  was  generated  under 
stock  funding.  The  purpose  of  the  funding  change  was 
to  alter  the  pattern  of  repairable  demands  and  carcass 
returns . 

5)  There  was  no  attempt  to  address  the  qualities  of  the 
UICP  recurring  demand  forecasting  scheme. 


B.  CONCLUSIONS 

From  the  study,  the  following  general  conclusions  can 
be  rendered. 

1)  Filtering  the  data  prior  to  applying  any  forecasting 
technique  is  critical.  This  point  was  illustrated  for 
all  the  forecasting  models  when  a  gross  filter  was 
applied  across  the  board  against  all  data.  The  current 
UICP  model  which  SPCC  uses  already  employs  a  filter 
which  was  apparent  in  the  results. 

2)  The  autoregressive  models  were  superior  to  the  causal 
models.  Despite  the  cause  and  effect  relationship  of 
recurring  demands  to  carcass  returns,  the  methods  that 
attempted  to  model  this  relationship  did  not  forecast 
carcass  returns  as  well  as  the  models  predicated  upon 
previous  carcass  return  patterns.  This  may  tend  to 
indicate  that  the  two  events  follow  separate  under¬ 
lying  distribution  patterns. 

3)  The  exponential  smoothing  models  were  the  best  of  the 
autoregressive  models.  The  SPCC  model,  the  adaptive 
response  rate  model  and  the  pure  exponential  smoothing 
models  all  work  on  the  same  basic  principle.  For  use 
with  raw  data,  the  straight  exponential  smoothing  model 
with  a  »  .4  (no  filtering)  does  as  well  or  better  a 
job  of  forecasting  as  does  the  current  UICP  model. 

4)  The  carcass  return  -  recurring  demand  relationship 
could  not  be  definitely  established  through  regression 
analysis.  Without  filtering,  all  the  models  demon¬ 
strated  r2  statistics  of  approximately  .5  with  stan¬ 
dard  deviations  of  approximately  20.  The  regression 
models  determined  from  the  filtered  data  showed 
significant  improvement  in  both  statistics,  but  still 
exhibited  large  standard  deviations  of  around  10. 
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5)  The  best  forecasts  made  by  the  models  were  not  very 
good  from  a  relative  standpoint.  The  best  mean 
edDsolute  percentage  error  was  64  percent.  This 
results  in  a  very  wide  confidence  band  around  an 
estimate  and  does  not  eliminate  the  uncertainty 
surrounding  the  long  procurement  lead  times  that  the 
forecasting  models  are  used  for.  This  is  a  result 
of  one  or  both  of  the  following: 

a)  the  true  underlying  distribution  of  carcass  returns 
is  still  not  properly  identified,  or 

b)  there  are  other  factors  causing  wide  data 
fluctuations . 

These  factors  could  include  policies,  funding,  reporting 
procedures  and/or  handling  procedures.  These  factors 
obviously  affect  the  recurring  demand  and  carcass  return 
patterns . 


C.  AREAS  FOR  FURTHER  STUDY 

The  following  areas  should  be  considered  for  further 
study: 

1)  outlier  analysis  techniques  -  how  to  properly  identify 
and  screen  outliers  from  the  data  base, 

2)  time-series  analysis  of  carcass  return  forecasting  - 
this  will  require  an  accvunulation  of  quarterly  data 
over  a  longer  time  period, 

3)  forecast  carcass  returns  as  a  function  of  fleet  item 
population  -  this  method  would  utilize  the  Weapons 
System  Files  at  SPCC  as  the  basis  for  forecasting, 

4)  regressions  based  upon  four  digit  ICP  COG  designations, 
and 

5)  the  effects  of  the  NSF-DLR  test  on  carcass  return 
rates  -  regressions  on  data  to  determine  before  and 
after  carcass  return  rates  as  functions  of  recurring 
demand. 

The  material  in  this  thesis  could  serve  as  a  baseline 
for  developing  the  above  topic  areas. 
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APPENDIX  A 


MOVING  LEAST  SQUARES  EXAMPLE 

QUARTER  12345 

ACTUAL  CARCASS  56247 

RETURNS 

n  =  4 

t*n  +  l  =  4  +  l  =  5 
First  Input  Qtrs  1-4 
X  coordinates  1-4,  Y  =  5,  6,  2,  4 
Regression  Line  f(X)  =  -.7X  +  6 
X  =  5 

Forecast  for  Qtr  5  *  f(5)  =  -.7(5)  +  6  =  2.5 
Second  Input  Qtrs  2-5 
X  coordinates  1-4,  Y  =  6,  2,  4,  7 
Regression  Line  f(X)  =  .5X  +  3.5 
X  »  5 

Forecast  for  Qtr  6  =  f(5)  =  .5(5)  +  3.5  *  6 
Third  Input  Qtrs  3-6 
X  coordinates  1-4,  Y  =  2,  4,  7,  8 
Regression  Line  f(X)  -  2.1X  0 

X  =  5 

Forecast  for  Qtr  7  »  f(5)  »  2.1(5)  *  10.5 


6  7  8 

8  8  9 


Actual  7 


Actual  8 


Actual  8 


t. 


Fourth  Input  Qtrs  4-7 
X  coordinates  1-4,  Y  =  4,  7,  8,  8 
Regression  Line  £  (X)  »  1.3X  3.5 

X  =  5 

Forecast  for  Qtr  8  *  f(5)  =  1.3(5)  +3.5  =  10 


Actual  9 
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APPENDIX  B 


THE  DATA  COLLECTION  PARAMETERS 


The  following  breakdown  is 

the  coding 

that 

was 

used 

collect  data  from  the  SPCC  THE 

file  for  each  listed 

data 

category ; 

DATA  CATEGORY 

D.I. 

CCl 

CC2 

NOTE 

Inductions  into  repair 

DAC 

* 

M 

DSC 

* 

M 

Collection  Point  Surveys 

DAC 

E 

H 

1 

D7C 

E 

H 

1 

DOP  surveys 

DAC 

M 

H 

DSC 

* 

H 

Assets  to  "A"  condition 

DAC 

M 

A 

DSC 

* 

A 

Demands  by  advice  codes 

AO- 

- 

- 

2 

A4- 

- 

- 

2 

D7- 

— 

- 

2 

NOTES; 

1.  any  unit  identification  code  as  part  of  the  requisition 
number  but  N00104  (indicating  SPCC  directed  survey) 

2.  the  three  document  identifiers  all  represent  recurring 
demand  requisitions  which  were  further  broken  down  into 
recurring  demands  per  quarter  by  specific  advice  codes 

*  emy  condition  code 

D.I.  document  identifier,  see  (Ref.  3] 

CC-  conditions  code,  see  (Ref.  3] 


APPENDIX  C 


RANDOM  SAMPLING  PLAN 

The  following  random  sampling  scheme  was  suggested  by 
Dr.  P.  A.  W.  Lewis,  Professor  of  Operations  Research  and 
Statistics,  Naval  Postgraduate  School,  Monterey,  Ca. 

The  objective  is  to  obtain  a  10  percent  sample  (or  430 
items)  out  of  a  population  of  4292  NIIN's  without  repeating 
any  items.  The  methodology  was  to  establish  a  vector,  call 
it  L(I) ,  with  4292  cells  and  an  index  register  where 
I  «  1,2, ... ,4292.  Initialize  the  value  in  each  cell  to 
correspond  to  the  cell  or  index  number  (i.e.  cell  1  or  L(l) 
contains  1,  L(2)  contains  2,  etc.).  Next  draw  a  pseudo 
random  number  (call  it  R(l))  from  the  uniform  [0,ll  distri¬ 
bution  using  the  IBM  IMSL  library  program  GGUBS.  Multiply 
R(l)  by  Imax  (the  maximum  value  in  the  index  register  -  4292 
at  this  point)  and  integerize  to  obtain  a  cell  number  (call 
it  N)  from  1  to  4292.  Then  go  to  vector  location  L(N)  and 
the  number  in  the  cell  is  the  first  number  for  the  sample. 
Replace  the  number  in  location  L(N)  by  the  number  in  L(Imax) 
(which  is  still  4292  in  this  case)  and  decrement  the  location 
index  I  by  one  (now  I  »  1,2, ... ,4291) .  Repeat  the  operation 
430  times.  The  result  is  a  vector  of  430  non-duplicate 
numbers  ranging  from  1  to  4292. 


The  master  NIIN  file  is  a  listing  of  all  4292  NIIN's  in 
numerically  ascending  order.  The  vector  represents  the 
relative  position  of  the  NIIN's  within  the  master  list  (i.e. 
number  2  in  the  vector  corresponds  to  the  second  NIIN  in  the 
master  NIIN  list) .  Then  using  a  locally  generated  utility 
program,  this  vector  is  applied  to  the  master  NIIN  file  and 
the  430  appropriate  NIIN's  are  extracted.  The  430  NIIN's 
represent  the  random  sample. 
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MEAN  FORECAST  ERROR 


MOE:  MEAN  FORECAST  ERROR 


MEAN  ABSOLUTE  PERCENTAGE  ERROR 


MOE:  MEAN  ABSOLUTE  PERCENTAGE  ERROR 
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MOE:  MEAN  ERROR  (RAW  DATA  AND  FILTERED  DATA) 
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APPENDIX  E 


ACRONYM  LISTING 


ACR 

actual  carcass  return 

ADV 

advice  code 

APA 

Appropriations  Procurement  Account 

ARD 

actual  recurring  demand 

ARR 

adaptive  response  rate 

COG 

cognizant  symbol 

CPS 

collection  point  surveys 

CRF 

carcass  return  forecast 

DDF 

Due-in/Due-out  File 

DEMAND 

demand/retum  model 

DEN 

data  element  number 

DLR 

depot  level  repairable 

DOP 

designated  overhaul  point 

DOPS 

designated  overhaul  point  survey 

EOQ 

economic  order  quantity 

ERQ 

economic  repair  quantity 

ES 

exponential  smoothing 

FMSO 

Navy  Fleet  Material  Support  Office 

ICP 

inventory  control  point 

IHF 

Inventory  History  File 

IND 

inductions  into  the  repair  phase 

HA 

moving  average  model 
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MAO  mean  absolute  deviation 

MAE  mean  absolute  error 

MATE  mean  absolute  forecast  error 

MAPE  mean  absolute  percentage  error 

MDF  Master  Data  File 

MFE  mean  forecast  error 

MLS  moving  least  squares  model 

MNE  mean  negative  error 

MOE  measures  of  effectiveness 

MPD  movement  priority  designation 

MPE  mean  positive  error 

NAVAIR  Naval  Air  Systems  Command 

NAVELEX  Naval  Electronics  Systems  Command 

NAVSEA  Naval  Sea  Systems  Conmtand 

NAVSUP  Naval  Supply  Systems  Command 

NIIN  national  item  identification  number 

NPS  Naval  Postgraduate  School 

NRFI  not  ready  for  issue 

NSF  Navy  Stock  Fund 

NSN  national  stock  number 

PPR  Plamned  Prograun  Requirements  Pile 

QTR  quarter 

RO  recurring  demauid 

RDF  recurring  demand  forecast 

REG  regression  model 

RFI  ready  for  issue 

i 

i 

i 
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BMSFE 


ROH 

RP 

RSR 

SAS 

SDR 

SMA 

spec 

STRAT 

THF 

TIR 

UICP 

WR 


root  mean  square  forecast  error 

regular  overhaul 

reorder  point 

repair  survival  rate 

Statistical  Analysis  System 

Supply  Demand  Review 

supply  material  availability 

Navy  Ships  Parts  Control  Center 

Stratification 

Transaction  History  File 

transaction  item  reporting 

Uniform  Automated  Data  Processing  System 
Control  Point 

wearout  rate 
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